| lifeless | fungi: ah, we seem to hit that repeatedly; perhaps we should document whats needed and put it in the trello we're working off of for this stuff? | 00:00 |
|---|---|---|
| *** piet has quit IRC | 00:01 | |
| fungi | lifeless: likely. it worked in the post pipeline for the branch tarballs, but since releases are tagged infrequently it wasn't spotted that this would break pre-release and release tarball jobs | 00:01 |
| fungi | jesusaur: did you have a patch up to support zuul-cloner use in tag-triggered pipelines? | 00:02 |
| *** thorst_ has joined #openstack-infra | 00:02 | |
| fungi | i keep meaning to track down and review that | 00:02 |
| *** sdake_ has joined #openstack-infra | 00:02 | |
| jeblair | why would that be different than post in this case? | 00:02 |
| jesusaur | fungi: 271585 but I'm struggling to get the tests passing | 00:03 |
| jeblair | (the branch tarball is supposed to be the exercise that verifies that things are expected to work on a tag) | 00:03 |
| fungi | jeblair: it's possible it wouldn't, though at the moment the {name}-tarball jobs aren't using zuul-cloner | 00:03 |
| *** sdake has quit IRC | 00:03 | |
| jhesketh | jeblair: cool, thanks, will look | 00:03 |
| jeblair | fungi: are you saying that the -branch-tarball and -tarball jobs are different? | 00:04 |
| fungi | jeblair: apparently | 00:04 |
| clarkb | fungi: how far is it now? | 00:04 |
| jeblair | fungi: they are intended to be the same | 00:04 |
| fungi | i just compared the definitions a little while ago when i was looking into this new failure | 00:04 |
| fungi | clarkb: gate-o's | 00:04 |
| mgagne | guys, a coworker found why some APT mirrors are triggering Hash Sum mismatch error | 00:04 |
| *** alex_xu has quit IRC | 00:05 | |
| clarkb | fungi: that "seems" faster | 00:05 |
| *** rbrndt_ has quit IRC | 00:05 | |
| mgagne | same for i18n files | 00:05 |
| clarkb | it used to take all day for 01 to update and now its ~halfway done? | 00:05 |
| *** akshai has quit IRC | 00:05 | |
| *** sdake has joined #openstack-infra | 00:05 | |
| fungi | mgagne: you mean other than having out of sync indices? | 00:05 |
| mgagne | fungi: yes! | 00:05 |
| *** edmondsw has quit IRC | 00:06 | |
| jeblair | fungi: how are they different? | 00:06 |
| mgagne | fungi: it is caused by addition of index files in the repo which the "original" sync script didn't consider | 00:06 |
| mgagne | fungi: https://www.debian.org/mirror/ftpmirror#how | 00:06 |
| mgagne | fungi: see rsync setup | 00:06 |
| mgagne | fungi: original script was "--exclude Packages* --exclude Sources* --exclude Release*" | 00:06 |
| mgagne | fungi: new version is "--exclude Packages* --exclude Sources* --exclude Release* --exclude InRelease --exclude i18n/* --exclude ls-lR*" | 00:06 |
| mgagne | fungi: so out of sync mirrors are in fact using an old version of the script or homemade script based on an older version of the wiki | 00:07 |
| *** alex_xu has joined #openstack-infra | 00:07 | |
| openstackgerrit | Colleen Murphy proposed openstack-infra/puppet-infracloud: (WIP) Add functional tests https://review.openstack.org/288840 | 00:07 |
| jeblair | fungi: i'm seeing gearman traffic from jenkins01 that looks consistent with normal operation, not massive reconfiguration | 00:07 |
| *** sdake_ has quit IRC | 00:07 | |
| fungi | mgagne: right, mirror operators using old or incorrect mirroring processes are pretty much always the reason for hash sum mismatch errors | 00:08 |
| mgagne | fungi: once we updated our script, reports are saying the errors aren't occurring anymore | 00:08 |
| mgagne | fungi: the fact that it's so widely spread shows a lack in the process | 00:08 |
| *** woodster_ has quit IRC | 00:09 | |
| mgagne | fungi: but that's the reason my coworker found | 00:09 |
| fungi | mgagne: glad it was a simple fix for you! | 00:09 |
| jeblair | fungi: i'm looking at the jjb templates, and -tarball and -branch-tarball look the same up to and including the build step | 00:09 |
| *** gongysh_ has joined #openstack-infra | 00:09 | |
| *** woodster_ has joined #openstack-infra | 00:10 | |
| *** gyee has joined #openstack-infra | 00:10 | |
| fungi | ahh, yeah i was comparing the logs, sorry. there may have been a slice of time where it was working and then stopped perhaps. i'll pull those back up again | 00:10 |
| *** gyee has quit IRC | 00:11 | |
| fungi | jeblair: right, so they are both using gerrit-git-prep at least | 00:11 |
| *** doug-fish has joined #openstack-infra | 00:11 | |
| openstackgerrit | Craige McWhirter proposed openstack-infra/system-config: Initial commit of the Phabricator puppetry. https://review.openstack.org/289648 | 00:11 |
| * craige would love some eyes on this ^^ | 00:12 | |
| *** ccrouch has quit IRC | 00:13 | |
| fungi | jeblair: there we go. so the tox.ini change in that repo did in fact break their branch tarball builds as well | 00:13 |
| *** ccrouch has joined #openstack-infra | 00:13 | |
| fungi | http://logs.openstack.org/a3/a3cbe7787f3421279f0c5cdca531e09420224f4b/post/neutron-vpnaas-branch-tarball/0db3643/console.html.gz | 00:13 |
| fungi | dhellmann: ^ | 00:13 |
| jeblair | fungi: whew! | 00:13 |
| fungi | i guess someone was just looking for "recent" branch tarballs, but not necessarily that the commit which got tagged also built a branch tarball successfully | 00:14 |
| fungi | oh! | 00:14 |
| *** jamesmcarthur has joined #openstack-infra | 00:14 | |
| fungi | AJaeger's https://review.openstack.org/288930 change was _after_ the tagged commit | 00:14 |
| *** gyee has joined #openstack-infra | 00:15 | |
| fungi | dhellmann: so it looks like the point at which neutron-vpnaas was tagged for b3 is incapable of building a tarball. AJaeger fixed it but that change merged after what you tagged | 00:15 |
| fungi | dhellmann: so options are to tag a b4, or to just ignore that there's no b3 pre-release tarball and move on, or do more unseemly things to fabricate a b3 tarball for it | 00:16 |
| *** tsg has quit IRC | 00:17 | |
| *** kevinsho_ has joined #openstack-infra | 00:17 | |
| *** ddieterly[away] has quit IRC | 00:17 | |
| *** ddieterly has joined #openstack-infra | 00:18 | |
| *** ddieterly has quit IRC | 00:19 | |
| *** ccrouch has quit IRC | 00:20 | |
| *** Qiming has quit IRC | 00:23 | |
| clarkb | peple here may nerd out over the logistics involved in http://www.exploratorium.edu/blogs/eclipse/why-woleai | 00:23 |
| *** fawadkhaliq has joined #openstack-infra | 00:23 | |
| *** annegentle has joined #openstack-infra | 00:24 | |
| clarkb | fungi: must be getting close to done? | 00:24 |
| clarkb | fungi: we can probably try doing 02-04 togethre since 01 didn't affect the geard server | 00:24 |
| fungi | clarkb: we're in gate-x's so still got a while | 00:25 |
| fungi | but i can certainly fire up a couple more | 00:25 |
| clarkb | fungi: I think it is worth doing since we don't see the crazy load on the gearman server | 00:25 |
| jeblair | ++ | 00:26 |
| fungi | also jenkins02 finally wrapped up, so i'm restarting it now | 00:26 |
| jeblair | i have to step away; but it's easy to keep an eye on the server with top and/or tcpdump | 00:26 |
| openstackgerrit | Sachi King proposed openstack-dev/pbr: Do not silently drop markers that fail to evaluate https://review.openstack.org/289628 | 00:27 |
| clarkb | gate-x I am trying to do napkin math, probably at least another 45 minutes? | 00:27 |
| clarkb | that is still much faster than old runs if so | 00:27 |
| *** annegentle has quit IRC | 00:29 | |
| bkero | clarkb: next Openstack dev summit in Woleai? | 00:29 |
| clarkb | bkero: if only they had the infastructure | 00:29 |
| fungi | clarkb: we bring the infrastructure | 00:29 |
| clarkb | we could have sessions on the beach and in nahses | 00:29 |
| anteaya | clarkb: the elipse is exact at 1:54 utc | 00:29 |
| anteaya | and the map is interesting | 00:30 |
| anteaya | eclipse | 00:30 |
| fungi | clarkb: tasty, tasty bottled infrastructure | 00:30 |
| anteaya | isn't that what you are brewing clarkb? | 00:30 |
| clarkb | I have never been but know many people that have, it is very rudimentary | 00:30 |
| anteaya | some infrastructure | 00:30 |
| *** salv-orlando has joined #openstack-infra | 00:30 | |
| fungi | hrm, corrupt jjb cache on 02 | 00:30 |
| bkero | clarkb: How about Chuuk then? | 00:31 |
| bkero | 54k people, should have the infra :) | 00:31 |
| openstackgerrit | Colleen Murphy proposed openstack-infra/puppet-infracloud: Update parameters for puppet-apply test dance https://review.openstack.org/290202 | 00:31 |
| clarkb | bkero: pohnpei or palau would be better bets | 00:31 |
| clarkb | chuuk is interesting in that the population is largely spread out | 00:31 |
| clarkb | weno is the biggest area but still tiny | 00:31 |
| bkero | Pohnpei would also work :) You'd know best | 00:32 |
| fungi | weno: biggest little city in micronesia? | 00:32 |
| anteaya | clarkb: does one have to fly to yap to get to pohnpei? | 00:32 |
| anteaya | did I remember you saying that? | 00:33 |
| clarkb | anteaya: no, yap is on the way to palau but I think there are gum to palau directs now | 00:33 |
| anteaya | gum | 00:33 |
| anteaya | that is a new one for me | 00:33 |
| anteaya | cool | 00:33 |
| clarkb | anteaya: the plane to pohnpei does guam (gum), chuuk, pohnpei, kosrae, kwaj, majuro, honolulu | 00:33 |
| openstackgerrit | Craige McWhirter proposed openstack-infra/system-config: Initial commit of the Phabricator puppetry. https://review.openstack.org/289648 | 00:33 |
| fungi | i take it gum is the iata airport code for guam? | 00:34 |
| bkero | So it's "fly to Honolulu, catch crazylongplane to pohnpei" | 00:34 |
| clarkb | fungi: ya | 00:34 |
| anteaya | ah | 00:34 |
| bkero | I'm down :3 | 00:34 |
| *** kevinsho_ has quit IRC | 00:35 | |
| *** fawadkhaliq has quit IRC | 00:35 | |
| anteaya | gum isn't bad as airport codes go | 00:35 |
| clarkb | yap is really neat because they have retained much more of their culture than many of the other islands | 00:35 |
| clarkb | tattooing didn't go away until after the war I think | 00:35 |
| clarkb | and they have stone money | 00:36 |
| anteaya | stone money | 00:36 |
| anteaya | that sounds interesting | 00:36 |
| anteaya | is it like the big big cirles you need 6 people to carry around? | 00:36 |
| anteaya | that kind of stone money? | 00:36 |
| * bkero is reminded of some impractical H2G2 money | 00:36 | |
| fungi | heh | 00:37 |
| * anteaya remembers an illustration from a book she read when very small | 00:37 | |
| clarkb | anteaya: yes that kind | 00:37 |
| *** bapalm has quit IRC | 00:37 | |
| bkero | Then again our Money is made out of shiny bits of metal, OR pieces of green paper | 00:37 |
| clarkb | value is supposedly related to the number of individuals that died bringing the money over the ocean to its home | 00:37 |
| fungi | the "triganic pu" | 00:37 |
| anteaya | wow | 00:38 |
| clarkb | anteaya: https://en.wikipedia.org/wiki/Rai_stones | 00:38 |
| clarkb | apparently there is one in ottowa | 00:38 |
| bkero | fungi: exactly! | 00:38 |
| bkero | fungi: I don't deal with piddling small change though | 00:38 |
| mordred | wow | 00:39 |
| mordred | "While the monetary system of Yap appears to use these giant stones as tokens, in fact it relies on an oral history of ownership. Being too large to move, buying an item with these stones is as easy as saying it no longer belongs to you. As long as the transaction is recorded in the oral history, it will now be owned by the person you passed it on to—no physical movement of the stone is required." | 00:39 |
| mordred | that's the most amazing paragraph I've ever read on any subject | 00:39 |
| anteaya | I love this part large rai being transported by canoe and outrigger was accidentally dropped and sank to the sea floor. Although it was never seen again, everyone agreed that the rai must still be there, so it continued to be transacted as genuine currency. | 00:40 |
| docaedo | sounds basically like bitcoin to me, except without a blockchain | 00:40 |
| bkero | fungi: I believe we've stumbled upon Adams' influence | 00:40 |
| fungi | okay, jenkins01-04 are running jjb updates now, and 05-07 are in graceful shutdown. i'll clear their accumulated ready nodes shortly | 00:40 |
| mordred | anteaya: I was just loving that part | 00:40 |
| clarkb | fungi: did you update the plugin on 05-07 yet? | 00:40 |
| mordred | docaedo: I was also thinking that | 00:40 |
| anteaya | the level of trust amongst folks must be wonderful to experience | 00:40 |
| fungi | clarkb: i did not, updating it there next | 00:40 |
| *** salv-orlando has quit IRC | 00:40 | |
| fungi | i updated 104 while they were in shutdown | 00:41 |
| fungi | er, 1-4 | 00:41 |
| openstackgerrit | Colleen Murphy proposed openstack-infra/puppet-infracloud: Add functional tests https://review.openstack.org/288840 | 00:41 |
| anteaya | clarkb: thank you, that is incredible | 00:42 |
| anteaya | I'd love to witness that someday | 00:42 |
| *** apoorvad has quit IRC | 00:43 | |
| *** mriedem has joined #openstack-infra | 00:44 | |
| fungi | gearman-plugin is updated on jenkins05-07 and accumulated ready nodes deleted for them from nodepool now | 00:45 |
| craige | For anyone who may be playing along at home or otherwise interested, the current blocker to Phabricator migration is comment migration, as detailed at the bottom of this page: https://etherpad.openstack.org/p/maniphest-migration | 00:45 |
| anteaya | going to spend the next hour getting ready for the eclipse | 00:45 |
| fungi | jjb update on jenkins01 has gotten as far as the t's | 00:45 |
| anteaya | see you tomorrow | 00:45 |
| craige | Interested in other ways to match and migrate comments. | 00:46 |
| bkero | Bye | 00:46 |
| fungi | enjoy anteaya! | 00:46 |
| craige | I'm currently trawling through Storyboard code to see how the problem is solved there. | 00:46 |
| mordred | craige: I have the etherpad open - but my brain is poop right now, so I may not fully comprehend the joins until tomorrow | 00:47 |
| craige | No probs mordred. Thanks for taking a look. | 00:47 |
| * craige suspects the schema has changed and now needs a new was to resolve it. | 00:48 | |
| Clint | was (not was) | 00:48 |
| clarkb | zuul is still processing things, implying that there isn't more load making it mad | 00:49 |
| clarkb | so maybe not a huge win on the speed side (though still quicker), but definitely a win on making zuul less mad | 00:50 |
| fungi | jenkins03 apparently also had a corrupt/truncated jjb cache, so i had to blow that one away too | 00:50 |
| fungi | jenkins01 is still on reconfiguring, but it's as far as the x's now | 00:51 |
| clarkb | yap's runway was a coral crush until not too long ago. Continental told them that they had to pave it or service would stop when they switched to 737s | 00:52 |
| *** Jeffrey4l has joined #openstack-infra | 00:52 | |
| clarkb | for a long time they were landing 727s on a coral runway | 00:52 |
| fungi | wow! deletes are _way_ faster. those were by far the longest phase of the update before | 00:53 |
| fungi | clarkb: so total real duration for jenkins01 jjb update: 81m20s | 00:53 |
| clarkb | fungi: that is still faster but not as fast as I hoped | 00:54 |
| clarkb | fungi: I want to say it was several hours at least before | 00:54 |
| *** bapalm has joined #openstack-infra | 00:54 | |
| fungi | it had gotten that bad. though also keep in mind this was right after a jenkins restart and cleanup too | 00:54 |
| openstackgerrit | Ian Wienand proposed openstack-infra/puppet-openstackci: Add flexible-publish plugin https://review.openstack.org/290211 | 00:54 |
| clarkb | good point, it was an almost ideal situation | 00:54 |
| clarkb | the real win seems to be we don't make zuul stop by running the updates | 00:54 |
| fungi | these will reflect our best-case times | 00:54 |
| clarkb | which means we can run them all at once | 00:54 |
| fungi | and yeah, not blowing up the zuul is happymaking | 00:55 |
| ianw | fungi / jeblair : ^ think that is going to fly? seems like a useful thing to have anyway | 00:55 |
| *** harlowja has quit IRC | 00:55 | |
| jeblair | ianw: we've had a moratorium on new jenkins plugins for a few years | 00:56 |
| mordred | ianw: well, we're actively working on getting rid of jenkins | 00:56 |
| mordred | ianw: so adding new functionality to jenkins is somehting we'll need to replace soon | 00:56 |
| jeblair | iterestingly, afs is a likely candidate for that functionality... | 00:56 |
| mordred | jeblair: right? :) | 00:56 |
| jeblair | which of course, if we go this way for getting afs for centos, might make this a bit of a bootstrapping problem... | 00:57 |
| ianw | i'm open to ideas. the periodic job doesn't need to rebuild afs every single time, though it could | 00:57 |
| *** gongysh_ has quit IRC | 00:57 | |
| jeblair | (theoretically, we should be able to connect zuul to afs's gerrit ;) | 00:57 |
| openstackgerrit | Steven Dake proposed openstack-infra/project-config: kolla: publish to pypi https://review.openstack.org/220411 | 00:58 |
| jeblair | ianw: push sha1sums with the files, and check them? | 01:00 |
| ianw | jeblair: pretty sure they would include timestamps so change every time | 01:01 |
| *** mtanino has quit IRC | 01:02 | |
| craige | I've added more content to the etherpad mordred. Hopefuly that helps get into my headspace. | 01:02 |
| *** andreww has quit IRC | 01:02 | |
| jeblair | ianw: wait, i'm not sure i follow the assertion "I would end up overwriting the files there with a blank directory" | 01:03 |
| jeblair | ianw: i think if you point the scp plugin at an empty directory, it will just copy no files | 01:03 |
| ianw | jeblair: well, that would work. i figured it would make the remote end try to look like the local end (and hence wipe it) | 01:04 |
| ianw | but, i've never had reason to try that | 01:04 |
| openstackgerrit | Ian Wienand proposed openstack-infra/project-config: [WIP] initial script for building AFS https://review.openstack.org/290214 | 01:06 |
| ianw | jeblair: ^ just working on the job definition, but that's the idea | 01:06 |
| *** sdague has joined #openstack-infra | 01:07 | |
| fungi | ianw: the scp publisher plugin doesn't remove remote files like, say rsync --delete would | 01:07 |
| jeblair | ianw: cool; yeah, i think you can just uncomment your check in that | 01:08 |
| fungi | it replaces them if the old file has teh same name as the new one it's copying | 01:08 |
| ianw | sweet, ok, looks like that's solved. i ran the build on my local devstack-centos7 and it all went ok | 01:09 |
| ianw | 369.80user 91.34system 7:36.48elapsed 101%CPU (0avgtext+0avgdata 73044maxresident)k | 01:09 |
| ianw | so it's not "lightweight" :) | 01:10 |
| *** sridhar_ram has quit IRC | 01:10 | |
| *** sridhar_ram has joined #openstack-infra | 01:10 | |
| *** apoorvad has joined #openstack-infra | 01:10 | |
| fungi | 7 minute build time? | 01:12 |
| fungi | try building gerrit war files | 01:13 |
| fungi | which we also do in gate jobs | 01:13 |
| ianw | ... what is it good for ... absolutely nothing .... | 01:14 |
| clarkb | fungi: are the updates on 03/04 still appreciably faster? | 01:14 |
| fungi | clarkb: i think so. 04 is on gate-n's now | 01:14 |
| *** sridhar_ram has quit IRC | 01:15 | |
| fungi | 03 started later because i missed it had a corrupt cache hanging around, so it's only on the d's | 01:15 |
| fungi | as opposed to 02, which started before 04, and is only on the f's | 01:15 |
| *** ZZelle_ has quit IRC | 01:16 | |
| *** bdemers has joined #openstack-infra | 01:19 | |
| mordred | ianw: awesome! | 01:19 |
| *** Qiming has joined #openstack-infra | 01:19 | |
| *** sdake has quit IRC | 01:20 | |
| *** asettle has quit IRC | 01:20 | |
| ianw | mordred: so, my theory being, puppet-afs can point itself at that, and then it just has to know how to install the client & dkms package ... which sounds much more tractable for puppet | 01:22 |
| fungi | jeblair: you probably want to weigh in on http://lists.openstack.org/pipermail/openstack-dev/2016-March/088641.html since "make zuul support atomic cross-repo dependencies" is how the horizon team has figured they should solve xstatic dependency updates | 01:24 |
| *** ddieterly has joined #openstack-infra | 01:25 | |
| *** zz_dimtruck is now known as dimtruck | 01:25 | |
| openstackgerrit | Merged openstack-dev/pbr: Use apt-cache generated packages to provide build deps https://review.openstack.org/289689 | 01:26 |
| *** pvaneck has quit IRC | 01:28 | |
| *** asettle has joined #openstack-infra | 01:30 | |
| *** gildub has joined #openstack-infra | 01:31 | |
| *** sarob has quit IRC | 01:33 | |
| openstackgerrit | Merged openstack-infra/tripleo-ci: set -o pipefail in deploy.sh https://review.openstack.org/287433 | 01:34 |
| *** asettle has quit IRC | 01:35 | |
| *** daemontool has joined #openstack-infra | 01:37 | |
| *** sdague has quit IRC | 01:38 | |
| jhesketh | jeblair: btw, when you get some time, it'd be handy to get master merged into zuulv3 https://review.openstack.org/#/c/279364/ | 01:38 |
| *** andreww has joined #openstack-infra | 01:43 | |
| *** gongysh has joined #openstack-infra | 01:44 | |
| *** sdague has joined #openstack-infra | 01:46 | |
| fungi | jenkins05 is idle so cleaning up and restarting it now | 01:46 |
| openstackgerrit | Ian Wienand proposed openstack-infra/project-config: Build AFS RPM's for Centos7 periodically https://review.openstack.org/290214 | 01:48 |
| *** jamesmcarthur has quit IRC | 01:49 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/project-config: Build AFS RPMs for Centos7 periodically https://review.openstack.org/290214 | 01:49 |
| *** jamesmcarthur has joined #openstack-infra | 01:50 | |
| fungi | jjb updates are going on jenkins05 now | 01:51 |
| *** tsg has joined #openstack-infra | 01:52 | |
| fungi | still waiting for some tripleo jobs to wrap up on 06 and 07 before i can restart them | 01:52 |
| *** mtanino has joined #openstack-infra | 01:53 | |
| *** _amrith_ is now known as amrith | 01:55 | |
| *** cloudtrainme has joined #openstack-infra | 01:55 | |
| *** ashleighfarnham has quit IRC | 01:55 | |
| *** salv-orlando has joined #openstack-infra | 01:57 | |
| craige | 1/away on the road. | 01:58 |
| *** esikachev has joined #openstack-infra | 01:58 | |
| *** tsg has quit IRC | 01:58 | |
| *** bpokorny has quit IRC | 02:02 | |
| *** esikachev has quit IRC | 02:03 | |
| *** IlyaG_ has quit IRC | 02:03 | |
| openstackgerrit | Ramy Asselin proposed openstack-infra/elastic-recheck: Add missing space to single_patch query https://review.openstack.org/290230 | 02:04 |
| *** salv-orlando has quit IRC | 02:04 | |
| *** sdague has quit IRC | 02:05 | |
| *** yamamoto_ has joined #openstack-infra | 02:06 | |
| *** baoli has joined #openstack-infra | 02:06 | |
| openstackgerrit | Ramy Asselin proposed openstack-infra/elastic-recheck: Add missing spaces to queries https://review.openstack.org/290230 | 02:06 |
| openstackgerrit | Ramy Asselin proposed openstack-infra/elastic-recheck: Add missing spaces to queries https://review.openstack.org/290230 | 02:07 |
| *** asettle has joined #openstack-infra | 02:08 | |
| openstackgerrit | amrith proposed openstack/requirements: Block pymongo version 3.1 https://review.openstack.org/290233 | 02:09 |
| openstackgerrit | amrith proposed openstack/requirements: Block pymongo version 3.1 https://review.openstack.org/290233 | 02:10 |
| fungi | jenkins07 is idle now, so cleaning it up, restarting it and firing up jjb updates on it | 02:14 |
| fungi | clarkb: oddly, duration for jenkins04 was longer, but maybe that's because it was competing with other simultaneous updates from other master for longer? 98m52s | 02:15 |
| mordred | fits138danzi | 02:16 |
| Clint | o rly | 02:16 |
| mordred | Clint: yup | 02:16 |
| * Clint nods. | 02:16 | |
| * fungi logs into all mordred's things | 02:18 | |
| *** jamesmcarthur has quit IRC | 02:18 | |
| mordred | fungi: when you do, could you remind me what they all are? | 02:18 |
| *** doug-fish has quit IRC | 02:19 | |
| *** doug-fish has joined #openstack-infra | 02:19 | |
| *** ddieterly is now known as ddieterly[away] | 02:20 | |
| fungi | mordred: sure, i scraped them all from your ssh known_hosts file | 02:21 |
| *** doug-fis_ has joined #openstack-infra | 02:23 | |
| *** doug-fish has quit IRC | 02:24 | |
| openstackgerrit | amrith proposed openstack/requirements: Block pymongo version 3.1 https://review.openstack.org/290233 | 02:26 |
| *** doug-fis_ has quit IRC | 02:27 | |
| *** doug-fish has joined #openstack-infra | 02:29 | |
| *** [1]Thelo has joined #openstack-infra | 02:30 | |
| *** baoli has quit IRC | 02:32 | |
| *** Thelo has quit IRC | 02:33 | |
| *** [1]Thelo is now known as Thelo | 02:33 | |
| *** sdake has joined #openstack-infra | 02:33 | |
| *** baoli has joined #openstack-infra | 02:34 | |
| amrith | ttx, dhellmann, fungi ... I've sent up the changes for the pymongo issue. once the g-r change is merged, I'll recheck the trove change and hopefully we can get that merged too. | 02:35 |
| *** doug-fish has quit IRC | 02:35 | |
| *** armax has joined #openstack-infra | 02:35 | |
| *** hichihara has joined #openstack-infra | 02:35 | |
| fungi | thanks amrith! | 02:37 |
| *** woodster_ has quit IRC | 02:37 | |
| fungi | jenkins06 is idle now, so cleaning it up, restarting it and firing up jjb updates on it | 02:38 |
| *** tphummel has quit IRC | 02:40 | |
| *** doug-fish has joined #openstack-infra | 02:40 | |
| *** sridhar_ram1 has joined #openstack-infra | 02:41 | |
| *** Guest20145 has joined #openstack-infra | 02:41 | |
| *** andreww has quit IRC | 02:42 | |
| *** xarses has joined #openstack-infra | 02:44 | |
| *** doug-fish has quit IRC | 02:45 | |
| *** sridhar_ram1 has quit IRC | 02:45 | |
| *** Guest20145 has quit IRC | 02:46 | |
| fungi | jjb updates are going on 5 out of 7 of the numbered jenkins masters now, and cpu on zuul is basically idle | 02:47 |
| clarkb | that is promising | 02:49 |
| clarkb | it is possible that with the multithread updates and not dosing of zuul we can have quick reliable jjb | 02:49 |
| clarkb | fungi: does it make sense to stop one and try with multiple threads? | 02:50 |
| fungi | clarkb: jenkins05 just completed at 58m3s | 02:50 |
| fungi | multiple threads? | 02:50 |
| fungi | oh, jjb multithreading? | 02:50 |
| *** doug-fish has joined #openstack-infra | 02:50 | |
| fungi | i'm keener to get some baseline numbers off these runs and maybe try multiple threads on a future update | 02:52 |
| clarkb | ya | 02:52 |
| openstackgerrit | Merged openstack-dev/pbr: Clarifications around tags and version numbers https://review.openstack.org/289630 | 02:52 |
| fungi | if i hadn't started some yet it might have been another story | 02:52 |
| fungi | but the updates are all already partway done | 02:53 |
| *** yamahata has quit IRC | 02:53 | |
| *** mriedem has quit IRC | 02:54 | |
| fungi | jenkins03 is next in line to finish, looks like | 02:54 |
| clarkb | next time | 02:55 |
| *** doug-fish has quit IRC | 02:55 | |
| openstackgerrit | Armando Migliaccio proposed openstack-infra/elastic-recheck: Add query for neutron bug 1501515 https://review.openstack.org/290246 | 02:56 |
| openstack | bug 1501515 in neutron "DBReferenceError is raised when updating dvr port binding" [Medium,In progress] https://launchpad.net/bugs/1501515 - Assigned to Kevin Benton (kevinbenton) | 02:56 |
| fungi | i'm sure the lingering mysql anonymous accounts is not the last mass update we're going to discover we need in the wake of the ubuntu-trusty migration | 02:56 |
| *** yamamoto_ has quit IRC | 02:56 | |
| ianw | krotscheck / nibalizer : is there any point in keeping support for centos6 in puppet-openafs? -- it's more paths to go wrong, and i can't see who would use it / check for bitrot | 02:58 |
| fungi | krotscheck: it's cruft now--we don't have any centos 6.x servers left in production | 02:59 |
| mordred | ianw: I do not personally think we need centos6 in there | 02:59 |
| fungi | er, ianw ^ (sorry krotscheck!) | 02:59 |
| *** tqtran has quit IRC | 03:00 | |
| ianw | ok, that should make things more straight-forward | 03:01 |
| *** yonglihe has quit IRC | 03:02 | |
| *** gyee has quit IRC | 03:02 | |
| *** thorst_ has quit IRC | 03:05 | |
| *** rkukura has quit IRC | 03:05 | |
| *** thorst_ has joined #openstack-infra | 03:06 | |
| *** rkukura has joined #openstack-infra | 03:07 | |
| *** thorst_ has quit IRC | 03:14 | |
| openstackgerrit | Ryan Hallisey proposed openstack-infra/tripleo-ci: Allow the continer job to run again https://review.openstack.org/288915 | 03:18 |
| openstackgerrit | Armando Migliaccio proposed openstack-infra/elastic-recheck: Add query for neutron bug 1501515 https://review.openstack.org/290246 | 03:20 |
| *** ddieterly[away] has quit IRC | 03:20 | |
| openstack | bug 1501515 in neutron "DBReferenceError is raised when updating dvr port binding" [Medium,In progress] https://launchpad.net/bugs/1501515 - Assigned to Kevin Benton (kevinbenton) | 03:20 |
| nibalizer | ianw: no point at all | 03:21 |
| *** rhallisey has quit IRC | 03:23 | |
| openstackgerrit | Armando Migliaccio proposed openstack-infra/elastic-recheck: Add query for neutron bug 1501515 https://review.openstack.org/290246 | 03:25 |
| openstack | bug 1501515 in neutron "DBReferenceError is raised when updating dvr port binding" [Medium,In progress] https://launchpad.net/bugs/1501515 - Assigned to Kevin Benton (kevinbenton) | 03:25 |
| *** dims has quit IRC | 03:25 | |
| *** apoorvad has quit IRC | 03:27 | |
| *** dimtruck is now known as zz_dimtruck | 03:29 | |
| *** jpr1 has joined #openstack-infra | 03:29 | |
| *** zz_dimtruck is now known as dimtruck | 03:29 | |
| *** markvoelker has joined #openstack-infra | 03:30 | |
| *** _nadya_ has joined #openstack-infra | 03:30 | |
| *** salv-orlando has joined #openstack-infra | 03:32 | |
| *** _nadya_ has quit IRC | 03:35 | |
| *** salv-orlando has quit IRC | 03:35 | |
| openstackgerrit | Armando Migliaccio proposed openstack-infra/elastic-recheck: Add query for neutron bug 1553374 https://review.openstack.org/290257 | 03:36 |
| openstack | bug 1553374 in neutron "Intermittent failure in BGP API tests" [High,In progress] https://launchpad.net/bugs/1553374 - Assigned to Ryan Tidwell (ryan-tidwell) | 03:36 |
| *** gongysh has quit IRC | 03:36 | |
| *** sdake has quit IRC | 03:37 | |
| *** yamamoto_ has joined #openstack-infra | 03:39 | |
| *** dimtruck is now known as zz_dimtruck | 03:39 | |
| *** fedexo has joined #openstack-infra | 03:40 | |
| openstackgerrit | Merged openstack-dev/pbr: Do not silently drop markers that fail to evaluate https://review.openstack.org/289628 | 03:41 |
| *** cloudtrainme has quit IRC | 03:43 | |
| *** sdake has joined #openstack-infra | 03:43 | |
| *** cloudtrainme has joined #openstack-infra | 03:44 | |
| *** yamahata has joined #openstack-infra | 03:47 | |
| openstackgerrit | Nisha Agarwal proposed openstack/diskimage-builder: Add psmisc to the packages for ironic-agent https://review.openstack.org/289364 | 03:49 |
| *** cloudtrainme has quit IRC | 03:49 | |
| ianw | -bash-4.2$ ls /afs/openstack.org | 03:49 |
| ianw | mirror service user | 03:49 |
| ianw | that looks good | 03:50 |
| amrith | fungi, dhellmann, ttx, once the g-r change (https://review.openstack.org/#/c/290233/) merges, I can push the trove change (https://review.openstack.org/#/c/290236/) to merge. tests just passed on that change. thx | 03:51 |
| mordred | ianw: WOOT | 03:53 |
| * mordred hands ianw a box of magic beans | 03:53 | |
| *** jamielennox is now known as jamielennox|away | 03:54 | |
| *** binbincong has quit IRC | 03:57 | |
| *** esikachev has joined #openstack-infra | 03:59 | |
| *** sputnik13 has quit IRC | 03:59 | |
| *** links has joined #openstack-infra | 04:03 | |
| *** esikachev has quit IRC | 04:03 | |
| *** baoli has quit IRC | 04:04 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/puppet-openafs: Use CI built RPMs for CentOS7 https://review.openstack.org/290266 | 04:06 |
| *** amrith is now known as _amrith_ | 04:10 | |
| *** thorst_ has joined #openstack-infra | 04:12 | |
| *** binbincong has joined #openstack-infra | 04:14 | |
| *** asettle has quit IRC | 04:14 | |
| *** thorst_ has quit IRC | 04:19 | |
| *** asettle has joined #openstack-infra | 04:22 | |
| *** armax has quit IRC | 04:23 | |
| *** zz_dimtruck is now known as dimtruck | 04:33 | |
| *** camunoz has quit IRC | 04:35 | |
| *** camunoz has joined #openstack-infra | 04:35 | |
| *** asettle has quit IRC | 04:36 | |
| *** baoli has joined #openstack-infra | 04:37 | |
| *** yamahata has quit IRC | 04:37 | |
| *** yamahata has joined #openstack-infra | 04:38 | |
| *** treaki_ has joined #openstack-infra | 04:38 | |
| *** rlandy has quit IRC | 04:38 | |
| *** treaki__ has quit IRC | 04:41 | |
| *** baoli has quit IRC | 04:43 | |
| *** asettle has joined #openstack-infra | 04:44 | |
| *** ajmiller has joined #openstack-infra | 04:44 | |
| *** xarses has quit IRC | 04:45 | |
| *** ajmiller_ has joined #openstack-infra | 04:45 | |
| *** xarses has joined #openstack-infra | 04:46 | |
| *** fifieldt has joined #openstack-infra | 04:47 | |
| *** ajmiller__ has joined #openstack-infra | 04:47 | |
| *** baoli has joined #openstack-infra | 04:47 | |
| *** asettle has quit IRC | 04:48 | |
| *** ajmiller has quit IRC | 04:49 | |
| *** ajmiller_ has quit IRC | 04:51 | |
| *** AJaeger has quit IRC | 04:51 | |
| *** waynr has quit IRC | 04:51 | |
| *** AJaeger has joined #openstack-infra | 04:52 | |
| *** ajmiller__ has quit IRC | 04:52 | |
| *** waynr has joined #openstack-infra | 04:54 | |
| *** dimtruck is now known as zz_dimtruck | 04:54 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/project-config: Add Centos7 wheel cache jobs https://review.openstack.org/290272 | 04:54 |
| ianw | alright, i think everything is out there for centos7 pip caches | 04:55 |
| ianw | wheel caches even | 04:55 |
| *** rguillebert has quit IRC | 04:57 | |
| *** baoli has quit IRC | 05:00 | |
| *** camunoz has quit IRC | 05:01 | |
| *** xarses_ has joined #openstack-infra | 05:03 | |
| *** eliqiao has quit IRC | 05:04 | |
| *** eliqiao has joined #openstack-infra | 05:04 | |
| *** regXboi has joined #openstack-infra | 05:05 | |
| *** xarses has quit IRC | 05:06 | |
| *** regXboi has quit IRC | 05:06 | |
| *** salv-orlando has joined #openstack-infra | 05:07 | |
| openstackgerrit | Merged openstack-dev/pbr: fix some variable names https://review.openstack.org/285249 | 05:08 |
| *** ajmiller has joined #openstack-infra | 05:09 | |
| *** deepakcs has joined #openstack-infra | 05:12 | |
| deepakcs | mtreinish: around ? | 05:12 |
| *** salv-orlando has quit IRC | 05:13 | |
| *** claudiub has quit IRC | 05:15 | |
| *** thorst_ has joined #openstack-infra | 05:17 | |
| *** camunoz has joined #openstack-infra | 05:18 | |
| *** thorst_ has quit IRC | 05:23 | |
| *** sdake_ has joined #openstack-infra | 05:24 | |
| *** sdake has quit IRC | 05:27 | |
| *** harlowja_at_home has joined #openstack-infra | 05:29 | |
| *** baoli has joined #openstack-infra | 05:36 | |
| *** infra-red has joined #openstack-infra | 05:37 | |
| *** oanson has joined #openstack-infra | 05:37 | |
| *** infra-re_ has joined #openstack-infra | 05:38 | |
| *** jamesmcarthur has joined #openstack-infra | 05:38 | |
| *** baoli has quit IRC | 05:40 | |
| *** infra-red has quit IRC | 05:41 | |
| *** asettle has joined #openstack-infra | 05:43 | |
| *** noorul has joined #openstack-infra | 05:44 | |
| *** abregman has quit IRC | 05:46 | |
| *** jamesmcarthur has quit IRC | 05:46 | |
| *** fawadkhaliq has joined #openstack-infra | 05:47 | |
| *** asettle has quit IRC | 05:48 | |
| *** jamesmcarthur has joined #openstack-infra | 05:57 | |
| *** kushal has joined #openstack-infra | 05:57 | |
| *** esikachev has joined #openstack-infra | 05:59 | |
| *** asettle has joined #openstack-infra | 06:02 | |
| *** jamesmcarthur has quit IRC | 06:04 | |
| *** esikachev has quit IRC | 06:04 | |
| *** asettle has quit IRC | 06:07 | |
| *** rcernin has joined #openstack-infra | 06:09 | |
| *** _nadya_ has joined #openstack-infra | 06:09 | |
| *** bnemec has quit IRC | 06:11 | |
| *** annegentle has joined #openstack-infra | 06:12 | |
| *** annegentle has quit IRC | 06:17 | |
| *** jtomasek has joined #openstack-infra | 06:20 | |
| *** thorst_ has joined #openstack-infra | 06:21 | |
| *** hdd has quit IRC | 06:22 | |
| *** amotoki has joined #openstack-infra | 06:25 | |
| *** exploreshaifali has joined #openstack-infra | 06:26 | |
| *** binbincong has quit IRC | 06:26 | |
| *** binbincong has joined #openstack-infra | 06:27 | |
| *** infra-re_ has quit IRC | 06:28 | |
| *** camunoz has quit IRC | 06:28 | |
| *** thorst_ has quit IRC | 06:28 | |
| *** asselin__ has joined #openstack-infra | 06:29 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/requirements: Updated from generate-constraints https://review.openstack.org/288849 | 06:29 |
| *** aeng is now known as aeng_afk | 06:30 | |
| *** asselin_ has quit IRC | 06:31 | |
| *** salv-orlando has joined #openstack-infra | 06:31 | |
| *** salv-orlando has quit IRC | 06:36 | |
| *** fedexo has quit IRC | 06:41 | |
| *** HeOS has joined #openstack-infra | 06:44 | |
| *** esikachev has joined #openstack-infra | 06:45 | |
| *** _nadya_ has quit IRC | 06:45 | |
| *** camunoz has joined #openstack-infra | 06:51 | |
| *** chlong has quit IRC | 06:54 | |
| *** gildub has quit IRC | 06:54 | |
| *** esikachev has quit IRC | 06:57 | |
| *** gnuoy_ has joined #openstack-infra | 07:03 | |
| *** harlowja_at_home has quit IRC | 07:03 | |
| *** claudiub has joined #openstack-infra | 07:07 | |
| *** chlong has joined #openstack-infra | 07:07 | |
| *** gnuoy_ has quit IRC | 07:09 | |
| openstackgerrit | Steve Martinelli proposed openstack-infra/project-config: Add searchlightclient to list of OSC check plugins https://review.openstack.org/284811 | 07:13 |
| *** infra-red has joined #openstack-infra | 07:14 | |
| *** infra-re_ has joined #openstack-infra | 07:17 | |
| *** infra-red has quit IRC | 07:19 | |
| *** Hal has joined #openstack-infra | 07:20 | |
| *** Hal is now known as Guest88500 | 07:20 | |
| *** esker has quit IRC | 07:22 | |
| *** sputnik13_ has joined #openstack-infra | 07:23 | |
| *** esikachev has joined #openstack-infra | 07:24 | |
| *** thorst_ has joined #openstack-infra | 07:26 | |
| AJaeger | fungi, I noticed it was broken in the post pipeline and fixed it. I think the release was before my fix was done. | 07:26 |
| *** fawadkhaliq has quit IRC | 07:28 | |
| *** ildikov has quit IRC | 07:28 | |
| *** abregman has joined #openstack-infra | 07:29 | |
| *** infra-red has joined #openstack-infra | 07:32 | |
| *** thorst_ has quit IRC | 07:33 | |
| *** eglute has quit IRC | 07:35 | |
| *** d34dh0r53 has quit IRC | 07:36 | |
| *** sigmavirus24_awa has quit IRC | 07:36 | |
| AJaeger | fungi: so, I agree with your assesment of the vpnaas situation - it should be fixed now. | 07:36 |
| *** infra-re_ has quit IRC | 07:36 | |
| *** odyssey4me has quit IRC | 07:36 | |
| AJaeger | fungi, lifeless: We should either get soon a working solution for the post pipeline (jesaurus has a patch up - https://review.openstack.org/#/c/271585/ - that fails currently) or find a fall back solution. Can we add an empty constraints file? | 07:37 |
| AJaeger | lifeless: you spoke about a trello board - is that for constraints? Can you share it, please? | 07:37 |
| AJaeger | ianw, great to her about the centos7 caches! | 07:37 |
| *** cloudnull has quit IRC | 07:38 | |
| *** asettle has joined #openstack-infra | 07:40 | |
| *** odyssey4me has joined #openstack-infra | 07:41 | |
| Jeffrey4l | Is there anyone know how to make a mirror site for git.openstack.org? (except for clone manually.) | 07:46 |
| *** asettle has quit IRC | 07:47 | |
| *** kzaitsev_mb has joined #openstack-infra | 07:48 | |
| *** nmagnezi has joined #openstack-infra | 07:49 | |
| *** sputnik13_ has quit IRC | 07:55 | |
| *** asselin__ has quit IRC | 07:56 | |
| bkero | Jeffrey4l: grokmirror? :) | 07:59 |
| *** scheuran has joined #openstack-infra | 08:00 | |
| *** NobodyCa1 has joined #openstack-infra | 08:00 | |
| *** sdake_ is now known as sdake | 08:01 | |
| *** HeOS has quit IRC | 08:01 | |
| Jeffrey4l | seems cool, i will check that. do you have any idea about how to get notification when the git repo is update. Then I can start update my local mirror. does git.openstack.org has any of mechanism like this? | 08:03 |
| Jeffrey4l | bkero, ^ | 08:03 |
| *** NobodyCam has quit IRC | 08:03 | |
| bkero | I don't know, maybe someone else can comment on that | 08:04 |
| openstackgerrit | Steve Martinelli proposed openstack-infra/project-config: do not propose a new config file for liberty changes https://review.openstack.org/290316 | 08:05 |
| *** asettle has joined #openstack-infra | 08:05 | |
| *** esikachev has quit IRC | 08:06 | |
| *** rossella_s has joined #openstack-infra | 08:07 | |
| *** d0ugal has joined #openstack-infra | 08:09 | |
| *** dguitarbite has joined #openstack-infra | 08:10 | |
| *** e0ne has joined #openstack-infra | 08:10 | |
| *** esikachev has joined #openstack-infra | 08:11 | |
| *** asettle has quit IRC | 08:13 | |
| *** HeOS has joined #openstack-infra | 08:16 | |
| *** [HeOS] has joined #openstack-infra | 08:18 | |
| *** mikelk has joined #openstack-infra | 08:18 | |
| AJaeger | stevemar: seeing your change: Is the job setup wrongly so that it proposes a liberty update for master? | 08:18 |
| stevemar | AJaeger: you could look at it that way | 08:19 |
| *** e0ne has quit IRC | 08:19 | |
| stevemar | i guess we could change the proposal script to propose against $branch instead of master... | 08:19 |
| AJaeger | stevemar: if that's what you want ;) | 08:19 |
| stevemar | AJaeger: i doubt we will have many backported changed that include new config options, that sounds like something that shouldn't be backported | 08:20 |
| AJaeger | the job has : /usr/local/jenkins/slave_scripts/propose_updated_config_file.sh openstack/keystone master | 08:20 |
| *** HeOS has quit IRC | 08:21 | |
| *** exploreshaifali has quit IRC | 08:21 | |
| stevemar | AJaeger: ahhh | 08:22 |
| AJaeger | but I wonder where master is used in the script... | 08:22 |
| stevemar | AJaeger: looks like BRANCH=$2 | 08:22 |
| *** vincentfrancoise has left #openstack-infra | 08:22 | |
| stevemar | AJaeger: in the .sh file | 08:22 |
| * AJaeger looked at the wrong file ;( | 08:23 | |
| AJaeger | stevemar: yes, indeed | 08:23 |
| stevemar | AJaeger: :) | 08:23 |
| stevemar | AJaeger: anyway to get the branch info in the keystone-propose-config-updates job? | 08:23 |
| stevemar | my infra game is weak | 08:23 |
| *** matrohon has joined #openstack-infra | 08:23 | |
| AJaeger | ZUUL_REFNAME is the branch | 08:23 |
| AJaeger | I suggest you update that job - and if you really do not want to run it on liberty, keep your existing change | 08:24 |
| AJaeger | (so do both changes) | 08:24 |
| stevemar | AJaeger: ah i can just refernce that | 08:25 |
| stevemar | neat | 08:25 |
| stevemar | AJaeger: no, let's keep the liberty runs, let's see how it goes | 08:25 |
| *** arxcruz has joined #openstack-infra | 08:25 | |
| AJaeger | ok | 08:26 |
| stevemar | AJaeger: i'll fix it up | 08:26 |
| *** jlanoux has joined #openstack-infra | 08:27 | |
| yolanda | good morning | 08:28 |
| *** dizquierdo has joined #openstack-infra | 08:29 | |
| *** gildub has joined #openstack-infra | 08:30 | |
| stevemar | AJaeger: coming up... | 08:31 |
| stevemar | slow internet today :) | 08:31 |
| openstackgerrit | Steve Martinelli proposed openstack-infra/project-config: use the correct branch when proposing a new config file https://review.openstack.org/290316 | 08:31 |
| stevemar | there we go | 08:31 |
| *** thorst_ has joined #openstack-infra | 08:31 | |
| *** kzaitsev_mb has quit IRC | 08:32 | |
| *** vincentll has joined #openstack-infra | 08:35 | |
| *** thorst_ has quit IRC | 08:39 | |
| openstackgerrit | Merged openstack-infra/project-config: Add neutron lbaas dashboard to it's gerrit bot channel https://review.openstack.org/290137 | 08:39 |
| *** asettle has joined #openstack-infra | 08:41 | |
| *** pblaho has quit IRC | 08:41 | |
| openstackgerrit | Merged openstack-infra/project-config: kolla: publish to pypi https://review.openstack.org/220411 | 08:45 |
| *** daemontool_ has joined #openstack-infra | 08:47 | |
| openstackgerrit | Merged openstack-infra/project-config: Add searchlightclient to list of OSC check plugins https://review.openstack.org/284811 | 08:47 |
| *** shardy has joined #openstack-infra | 08:47 | |
| *** openstackgerrit has quit IRC | 08:47 | |
| *** openstackgerrit has joined #openstack-infra | 08:48 | |
| *** ihrachys has joined #openstack-infra | 08:48 | |
| *** esikachev has quit IRC | 08:49 | |
| *** asettle has quit IRC | 08:49 | |
| *** daemontool has quit IRC | 08:49 | |
| openstackgerrit | Steve Martinelli proposed openstack-infra/project-config: Revert "Add openstack client command overlap checking" https://review.openstack.org/290331 | 08:51 |
| openstackgerrit | Merged openstack-infra/project-config: Use ubuntu-trusty for releasenotes jobs https://review.openstack.org/289824 | 08:51 |
| openstackgerrit | yolanda.robla proposed openstack/diskimage-builder: Add dib element to generate logical volumes https://review.openstack.org/252041 | 08:51 |
| *** doug-fish has joined #openstack-infra | 08:52 | |
| *** kushal has quit IRC | 08:53 | |
| *** zeih_ has joined #openstack-infra | 08:54 | |
| *** zeih_ has quit IRC | 08:54 | |
| openstackgerrit | Steve Martinelli proposed openstack-infra/project-config: Revert "Add openstack client command overlap checking" https://review.openstack.org/290331 | 08:54 |
| *** zeih_ has joined #openstack-infra | 08:54 | |
| *** links has quit IRC | 08:55 | |
| openstackgerrit | Steven Hardy proposed openstack-infra/tripleo-ci: Move tripleo.sh into tripleo-ci repo https://review.openstack.org/272210 | 08:55 |
| *** ifarkas has joined #openstack-infra | 08:56 | |
| *** doug-fish has quit IRC | 08:57 | |
| *** abhishekk has joined #openstack-infra | 08:57 | |
| *** esikachev has joined #openstack-infra | 09:00 | |
| *** hashar has joined #openstack-infra | 09:04 | |
| abhishekk | Hi, | 09:05 |
| abhishekk | I am having one query, there is a cinder feature "NFS Snapshot" (https://review.openstack.org/#/c/147186) up for review. | 09:05 |
| abhishekk | I do see some CI jobs for Netapp, Nexenta and HDS HNAS NFS backends but no CI job for generic NFS. If I want to add these CI jobs how can I proceed. | 09:05 |
| abhishekk | Also NFS is not a vendor specific backend, so can CI jobs be placed in the community? | 09:05 |
| *** jaosorior has joined #openstack-infra | 09:06 | |
| *** dtantsur|afk is now known as dtantsur | 09:10 | |
| *** andreykurilin__ has joined #openstack-infra | 09:10 | |
| *** amotoki has quit IRC | 09:10 | |
| openstackgerrit | Merged openstack-infra/project-config: Add new experimental jobs for Kolla oraclelinux https://review.openstack.org/287957 | 09:11 |
| *** dizquierdo has quit IRC | 09:12 | |
| *** bapalm has quit IRC | 09:14 | |
| *** _degorenko|afk is now known as degorenko | 09:15 | |
| *** lucas-dinner is now known as lucasagomes | 09:16 | |
| *** sshnaidm has quit IRC | 09:17 | |
| AJaeger | stevemar: regarding the overlap check: Do you want to make it a warning instead of a hard failure for now? | 09:18 |
| *** sshnaidm has joined #openstack-infra | 09:18 | |
| *** exploreshaifali has joined #openstack-infra | 09:18 | |
| *** jistr has joined #openstack-infra | 09:19 | |
| AJaeger | abhishekk: best discuss within the cinder team on test strategy - and then follow http://docs.openstack.org/infra/manual/creators.html on adding a job (it explains far more but should get you going) | 09:19 |
| *** ildikov has joined #openstack-infra | 09:19 | |
| AJaeger | abhishekk: but check https://review.openstack.org/289589 - this might solve your suggestion | 09:20 |
| *** hichihara has quit IRC | 09:20 | |
| stevemar | AJaeger: sure, have a way to add a warning in mind? | 09:21 |
| stevemar | just log it? | 09:21 |
| *** salv-orlando has joined #openstack-infra | 09:21 | |
| AJaeger | stevemar: just log it - I commented. I would remove the return True | 09:21 |
| openstackgerrit | Merged openstack-infra/project-config: horizon: Use ubuntu-trusty https://review.openstack.org/289819 | 09:22 |
| abhishekk | AJaeger: thank you, I will have a look | 09:22 |
| *** yamahata has quit IRC | 09:23 | |
| *** d34dh0r53 has joined #openstack-infra | 09:23 | |
| *** eglute has joined #openstack-infra | 09:24 | |
| openstackgerrit | Merged openstack-infra/project-config: Use ubuntu-trusty for python-bitrot-jobs https://review.openstack.org/289793 | 09:25 |
| *** jcoufal has joined #openstack-infra | 09:25 | |
| *** amotoki has joined #openstack-infra | 09:25 | |
| *** sigmavirus24_awa has joined #openstack-infra | 09:26 | |
| *** cloudnull has joined #openstack-infra | 09:27 | |
| *** sobersabre has joined #openstack-infra | 09:27 | |
| *** bapalm has joined #openstack-infra | 09:27 | |
| sobersabre | hi guys. What do I need to get this merged: https://review.openstack.org/#/c/287497/ ? | 09:28 |
| AJaeger | sobersabre: what is it? | 09:28 |
| *** salv-orlando has quit IRC | 09:29 | |
| *** Jeffrey4l has quit IRC | 09:31 | |
| *** jordanP has joined #openstack-infra | 09:31 | |
| *** kambiz has quit IRC | 09:32 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Convert jenkins-plugin-jobs to ubuntu-trusty https://review.openstack.org/290348 | 09:32 |
| *** gongysh has joined #openstack-infra | 09:33 | |
| *** amotoki has quit IRC | 09:34 | |
| *** camunoz has quit IRC | 09:34 | |
| openstackgerrit | Steve Martinelli proposed openstack-infra/project-config: don't fail if commands overlap https://review.openstack.org/290351 | 09:34 |
| *** electrofelix has joined #openstack-infra | 09:34 | |
| *** camunoz has joined #openstack-infra | 09:34 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: periodic-{name}-{python}-with-oslo-master: ubuntu-trusty https://review.openstack.org/290352 | 09:35 |
| *** kambiz has joined #openstack-infra | 09:35 | |
| *** thorst_ has joined #openstack-infra | 09:36 | |
| openstackgerrit | Dmitry Tantsur proposed openstack-infra/project-config: Add a non-voting iPXE job to ironic-inspector https://review.openstack.org/290016 | 09:38 |
| stevemar | AJaeger: i don't think you guys run pep8 on the python files in project-config | 09:39 |
| *** _amrith_ is now known as amrith | 09:41 | |
| AJaeger | that's what I feared ;) Then it's fine... | 09:42 |
| *** amotoki has joined #openstack-infra | 09:43 | |
| *** thorst_ has quit IRC | 09:44 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Convert *plugin-jobs to ubuntu-trusty https://review.openstack.org/290348 | 09:44 |
| *** _nadya_ has joined #openstack-infra | 09:45 | |
| sobersabre | AJaeger: it's an update to google cloud storage plugin support in jenkins job builder. | 09:45 |
| *** derekh has joined #openstack-infra | 09:46 | |
| sobersabre | AJaeger: and if we're on a spree on that, there's this patch as well: https://review.openstack.org/#/c/199547 | 09:46 |
| sobersabre | it's an update to authorization matrix support plugin in jjb | 09:46 |
| stevemar | AJaeger: btw, i finished up this patch too :) https://review.openstack.org/#/c/290316/ | 09:46 |
| sobersabre | why aren't they just merged (tm) ? | 09:46 |
| sobersabre | who is managing change flow into the master? | 09:47 |
| sobersabre | IT's low risk update for both plugins that currently are diverged from their respective Jenkins plugins | 09:47 |
| sobersabre | covered by tests... working as cherry picks... | 09:48 |
| AJaeger | sobersabre: every change needs two +2 reviews by cors - and I'm not a core for that repository. | 09:48 |
| sobersabre | with +2 | 09:48 |
| sobersabre | :) | 09:48 |
| sobersabre | both are with +2 | 09:48 |
| AJaeger | *two* +2s | 09:48 |
| AJaeger | you have a single +2 | 09:48 |
| sobersabre | ah, it needs 2 of +2 reviews! ok. | 09:49 |
| sobersabre | LEmme bug those guys :) | 09:49 |
| AJaeger | and you can check the list of cores for each repository from gerrit, go to the projects list and check the access for it... | 09:49 |
| *** lezbar has quit IRC | 09:49 | |
| sobersabre | fdegir: ping | 09:49 |
| *** lezbar has joined #openstack-infra | 09:50 | |
| AJaeger | sobersabre: please try to avoid naked pings, state your reason so that when somebody reads backscroll can see the message and knows what needs doing... | 09:50 |
| *** amotoki has quit IRC | 09:51 | |
| *** lezbar has quit IRC | 09:51 | |
| *** e0ne has joined #openstack-infra | 09:51 | |
| sobersabre | hashar: ping need second +2 for updates to 2 jjb plugins | 09:51 |
| sobersabre | waynr: hashar: ping need second +2 for updates to 2 jjb plugins | 09:52 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Use ubuntu-trusty for pylint jobs https://review.openstack.org/290362 | 09:52 |
| *** lezbar has joined #openstack-infra | 09:52 | |
| sobersabre | zaro: are you zaro0508@gmail.com ? | 09:52 |
| *** amotoki has joined #openstack-infra | 09:55 | |
| *** kzaitsev_mb has joined #openstack-infra | 09:56 | |
| *** amotoki has quit IRC | 09:56 | |
| *** sfinucan has joined #openstack-infra | 09:57 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Convert javascript jobs to use ubuntu-trusty https://review.openstack.org/290368 | 09:58 |
| *** tpsilva has joined #openstack-infra | 10:01 | |
| *** e0ne has quit IRC | 10:01 | |
| *** [HeOS] has quit IRC | 10:01 | |
| *** claudiub|2 has joined #openstack-infra | 10:03 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Use ubuntu-trusty for salt-lint https://review.openstack.org/290372 | 10:03 |
| *** e0ne has joined #openstack-infra | 10:04 | |
| *** claudiub has quit IRC | 10:06 | |
| *** amotoki has joined #openstack-infra | 10:06 | |
| *** gongysh has quit IRC | 10:06 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: gate-{name}-chef-rake: Convert to ubuntu-trusty https://review.openstack.org/290373 | 10:07 |
| *** HeOS has joined #openstack-infra | 10:10 | |
| AJaeger | yolanda: I've pushed some more jobs to convert to ubuntu-trusty, see https://review.openstack.org/#/q/topic:bindep%20status:open for full list. Could you review them later today, please? | 10:12 |
| yolanda | AJaeger, will do | 10:12 |
| yolanda | are they ok to land? | 10:12 |
| AJaeger | pabelanger, fungi: Once the current changes are in we should have less than 100 jobs using bare-trusty. I've lost track which ones are missing, so will step back until most of them are merged ;) | 10:13 |
| AJaeger | yolanda: yes, those are ok to land. | 10:13 |
| yolanda | ++ | 10:13 |
| AJaeger | yolanda: only 289848 and 289785 should wait a bit longer for projects to comment on ... | 10:13 |
| *** bdemers has quit IRC | 10:17 | |
| *** daemontool_ is now known as daemontool | 10:19 | |
| *** infra-re_ has joined #openstack-infra | 10:19 | |
| openstackgerrit | Ghe Rivero proposed openstack-infra/shade: Add quotas support https://review.openstack.org/285110 | 10:21 |
| *** infra-red has quit IRC | 10:22 | |
| *** bdemers has joined #openstack-infra | 10:22 | |
| *** rguillebert has joined #openstack-infra | 10:23 | |
| *** zeih_ has quit IRC | 10:25 | |
| *** sambetts|afk is now known as sambetts | 10:28 | |
| *** abregman is now known as abregman|afk | 10:30 | |
| *** Qiming has quit IRC | 10:32 | |
| *** claudiub|2 has quit IRC | 10:32 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Update min-ready for {bare,ubuntu}-trusty https://review.openstack.org/290383 | 10:33 |
| *** asselin__ has joined #openstack-infra | 10:35 | |
| *** zeih has joined #openstack-infra | 10:38 | |
| *** zeih has quit IRC | 10:40 | |
| *** thorst_ has joined #openstack-infra | 10:42 | |
| *** yamamoto_ has quit IRC | 10:42 | |
| openstackgerrit | Merged openstack-infra/project-config: Convert bandit to ubuntu-trusty https://review.openstack.org/290094 | 10:43 |
| *** dtantsur is now known as dtantsur|brb | 10:49 | |
| *** thorst_ has quit IRC | 10:49 | |
| yolanda | AJaeger, from now on, the new jobs that are created shall be on ubuntu-trusty? | 10:50 |
| *** salv-orlando has joined #openstack-infra | 10:51 | |
| *** exploreshaifali has quit IRC | 10:54 | |
| openstackgerrit | Moshe Levi proposed openstack/diskimage-builder: Add lshw package to ironic-agent https://review.openstack.org/289233 | 10:55 |
| *** salv-orlando has quit IRC | 10:56 | |
| *** penguinolog has joined #openstack-infra | 10:56 | |
| *** abhishekk has left #openstack-infra | 10:57 | |
| openstackgerrit | Merged openstack-infra/project-config: Convert linters+bashate to use ubuntu-trusty https://review.openstack.org/289832 | 10:59 |
| penguinolog | Hi! Could anybody answer: is PEP8 for Python 3.x checked on Jenkins as PEP8 for Python 2.x? | 10:59 |
| openstackgerrit | Merged openstack-infra/project-config: Convert sahara to ubuntu-trusty https://review.openstack.org/289797 | 11:03 |
| *** sdague has joined #openstack-infra | 11:06 | |
| *** abregman|afk is now known as abregman | 11:06 | |
| *** dims has joined #openstack-infra | 11:07 | |
| kozhukalov | hey, guys, could you please explain me what should test runner do if we use several test threads and every thread needs its own database? I am aware of this change https://review.openstack.org/#/c/282425 that creates database before starting job. Should I create a patch to parameterize this job template so it is able to create several databases? Or maybe we | 11:07 |
| kozhukalov | should leave this (creating of several databases) up to a test runner? | 11:07 |
| *** ildikov has quit IRC | 11:08 | |
| openstackgerrit | Ihar Hrachyshka proposed openstack-infra/project-config: Don't run python34 job for neutron/kilo https://review.openstack.org/290397 | 11:10 |
| *** noorul has quit IRC | 11:10 | |
| kozhukalov | AJaeger: ^^ about database per test thread | 11:13 |
| *** rhallisey has joined #openstack-infra | 11:14 | |
| yolanda | AJaeger, i'm monitoring the job updates for jjb, currently it seems to be applying to jenkins01 | 11:17 |
| yolanda | i hope jjb don't crash... | 11:17 |
| openstackgerrit | Ricardo Carrillo Cruz proposed openstack-infra/infra-specs: Add extension to openstackci for next phase of work https://review.openstack.org/239810 | 11:17 |
| *** doug-fish has joined #openstack-infra | 11:17 | |
| AJaeger | thanks, yolanda for monitoring | 11:18 |
| AJaeger | yolanda: yes, no new bare-trusty jobs | 11:19 |
| AJaeger | kozhukalov: can't help with that | 11:19 |
| ihrachys | AJaeger: another fallout from constraints cleanup https://review.openstack.org/#/c/290397/ | 11:20 |
| AJaeger | thanks ihrachys for the change, +2 | 11:21 |
| *** vgridnev has joined #openstack-infra | 11:22 | |
| *** doug-fish has quit IRC | 11:22 | |
| *** Qiming has joined #openstack-infra | 11:22 | |
| sobersabre | hashar: https://review.openstack.org/#/c/199547 you're not in the list, but can you pls look and +2 it too? | 11:22 |
| *** nijaba has quit IRC | 11:24 | |
| *** _skolekonov is now known as skolekonov | 11:24 | |
| *** nijaba has joined #openstack-infra | 11:25 | |
| *** Daisy has joined #openstack-infra | 11:25 | |
| *** zeih has joined #openstack-infra | 11:28 | |
| *** Daisy has quit IRC | 11:29 | |
| *** Daisy has joined #openstack-infra | 11:30 | |
| *** hashar has quit IRC | 11:30 | |
| *** |-paul-| has joined #openstack-infra | 11:30 | |
| *** ldnunes has joined #openstack-infra | 11:32 | |
| *** mattt has left #openstack-infra | 11:33 | |
| *** mattt has joined #openstack-infra | 11:33 | |
| *** kmartin has quit IRC | 11:33 | |
| *** yamamoto_ has joined #openstack-infra | 11:33 | |
| *** Daisy has quit IRC | 11:34 | |
| *** Daisy has joined #openstack-infra | 11:34 | |
| openstackgerrit | Alexey Ovchinnikov proposed openstack-infra/project-config: Add publishing capability to buildimage-lxd job https://review.openstack.org/290418 | 11:34 |
| *** ociuhandu has quit IRC | 11:35 | |
| dims | fungi : sdague : the review to get devstack-gate unit tests running is ready, please peek when you get a chance - https://review.openstack.org/#/c/289969/ | 11:35 |
| openstackgerrit | Ana Krivokapic proposed openstack-infra/project-config: Remove Tuskar https://review.openstack.org/290419 | 11:35 |
| sdague | dims: cool, will do as soon as I sort out some unit tests for mriedem | 11:36 |
| openstackgerrit | yolanda.robla proposed openstack/diskimage-builder: Add dib element to generate logical volumes https://review.openstack.org/252041 | 11:36 |
| dims | thanks sdague | 11:36 |
| *** tosky has joined #openstack-infra | 11:38 | |
| *** Daisy has quit IRC | 11:41 | |
| *** Daisy has joined #openstack-infra | 11:41 | |
| *** chlong has quit IRC | 11:42 | |
| *** akrivoka has joined #openstack-infra | 11:42 | |
| *** exploreshaifali has joined #openstack-infra | 11:45 | |
| openstackgerrit | Alexey Ovchinnikov proposed openstack-infra/project-config: Add publishing capability to buildimage-lxd job https://review.openstack.org/290418 | 11:45 |
| sdague | dims: ok, this gets a little nutty in shell pipelines, but it would be kind of nice to know the count on each type of exception - https://review.openstack.org/#/c/289901/2/functions.sh | 11:46 |
| *** Daisy has quit IRC | 11:46 | |
| sdague | because that might help us catch when people do warnings incorrectly | 11:46 |
| *** thorst_ has joined #openstack-infra | 11:47 | |
| *** links has joined #openstack-infra | 11:48 | |
| dims | sdague : good point, i'll try to figure out how to do that better | 11:49 |
| dims | sdague : hmm, i pasted you the wrong link :) https://review.openstack.org/#/c/289969/ << this one is the one that breaks unit tests :) | 11:50 |
| dims | take that back, i did paste the right link above | 11:50 |
| *** amrith is now known as _amrith_ | 11:51 | |
| *** pots has quit IRC | 11:52 | |
| openstackgerrit | Ivan Kolodyazhny proposed openstack-infra/project-config: Add gate job for Cinder Functional tests https://review.openstack.org/287115 | 11:53 |
| *** thorst_ has quit IRC | 11:53 | |
| e0ne | hi infra team! can anybody please help me with patch above ^^. zuul check still fails on my patch:( | 11:53 |
| openstackgerrit | Ryan Hallisey proposed openstack-infra/tripleo-ci: Allow the continer job to run again https://review.openstack.org/288915 | 11:55 |
| *** zeih has quit IRC | 11:55 | |
| *** pots has joined #openstack-infra | 11:56 | |
| *** HeOS has quit IRC | 12:01 | |
| *** HeOS has joined #openstack-infra | 12:01 | |
| openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: Allow the continer job to run again https://review.openstack.org/288915 | 12:02 |
| *** jaosorior has quit IRC | 12:02 | |
| *** jaosorior has joined #openstack-infra | 12:02 | |
| sdague | dims: oh, that one, right | 12:03 |
| sdague | dims: yeh, that seems fine for now. I feel like we should circle around to figure out if that's really the way we want to do that later | 12:03 |
| *** cloudtrainme has joined #openstack-infra | 12:03 | |
| *** ildikov has joined #openstack-infra | 12:04 | |
| *** rfolco has joined #openstack-infra | 12:04 | |
| openstackgerrit | Alexey Ovchinnikov proposed openstack-infra/project-config: Add publishing capability to buildimage-lxd job https://review.openstack.org/290418 | 12:04 |
| *** salv-orlando has joined #openstack-infra | 12:06 | |
| *** aysyd has joined #openstack-infra | 12:06 | |
| *** zhurong_ has joined #openstack-infra | 12:07 | |
| *** amotoki has quit IRC | 12:10 | |
| openstackgerrit | Merged openstack-dev/pbr: Correct typo - s/enabeld/enabled/ https://review.openstack.org/289623 | 12:12 |
| openstackgerrit | yolanda.robla proposed openstack/diskimage-builder: Add dib element to generate logical volumes https://review.openstack.org/252041 | 12:12 |
| *** cloudtrainme has quit IRC | 12:13 | |
| *** chlong has joined #openstack-infra | 12:14 | |
| *** yamamoto_ has quit IRC | 12:16 | |
| *** sputnik13_ has joined #openstack-infra | 12:16 | |
| *** dtantsur|brb is now known as dtantsur | 12:18 | |
| *** infra-red has joined #openstack-infra | 12:19 | |
| *** ociuhandu has joined #openstack-infra | 12:20 | |
| *** lucasagomes is now known as lucas-hungry | 12:21 | |
| *** baoli has joined #openstack-infra | 12:22 | |
| *** kushal has joined #openstack-infra | 12:22 | |
| AJaeger | e0ne: I'll check and comment... | 12:22 |
| *** infra-re_ has quit IRC | 12:22 | |
| *** daemontool_ has joined #openstack-infra | 12:23 | |
| *** amotoki has joined #openstack-infra | 12:24 | |
| *** nelsnels_ has joined #openstack-infra | 12:24 | |
| *** eric_lopez has joined #openstack-infra | 12:25 | |
| wznoinsk | hi all, could someone have a look at https://review.openstack.org/#/c/290442/ ? thanks | 12:25 |
| *** MCoLo__ has joined #openstack-infra | 12:26 | |
| *** kingia has joined #openstack-infra | 12:26 | |
| *** baoli has quit IRC | 12:26 | |
| *** greghaynes has quit IRC | 12:27 | |
| *** kingia_ has quit IRC | 12:27 | |
| *** ryanpetrello has quit IRC | 12:27 | |
| *** niska has quit IRC | 12:27 | |
| *** chlong has quit IRC | 12:27 | |
| *** rhallisey has quit IRC | 12:27 | |
| *** dguitarbite has quit IRC | 12:27 | |
| *** nelsnelson has quit IRC | 12:27 | |
| *** Mmike has quit IRC | 12:27 | |
| *** elo has quit IRC | 12:27 | |
| *** msuriar has quit IRC | 12:27 | |
| *** MCoLo___ has quit IRC | 12:27 | |
| *** tristanC has quit IRC | 12:27 | |
| *** jaosorior has quit IRC | 12:27 | |
| *** bapalm has quit IRC | 12:27 | |
| *** daemontool has quit IRC | 12:27 | |
| *** abregman has quit IRC | 12:27 | |
| *** AJaeger has quit IRC | 12:27 | |
| *** alaski has quit IRC | 12:27 | |
| *** mescanef has quit IRC | 12:27 | |
| *** zeus has quit IRC | 12:27 | |
| *** abregman has joined #openstack-infra | 12:27 | |
| *** jaosorior has joined #openstack-infra | 12:27 | |
| *** tristanC has joined #openstack-infra | 12:27 | |
| *** Mmike has joined #openstack-infra | 12:27 | |
| *** bapalm has joined #openstack-infra | 12:27 | |
| e0ne | AJaeger: thank you for the help | 12:28 |
| *** dalgaaf has joined #openstack-infra | 12:28 | |
| *** daemontool_ is now known as daemontool | 12:29 | |
| *** amotoki has quit IRC | 12:29 | |
| *** zeus has joined #openstack-infra | 12:30 | |
| *** [1]Thelo has joined #openstack-infra | 12:30 | |
| *** zeus is now known as Guest8646 | 12:30 | |
| *** sputnik13_ has quit IRC | 12:30 | |
| *** doug-fish has joined #openstack-infra | 12:31 | |
| *** alaski has joined #openstack-infra | 12:31 | |
| *** Daisy has joined #openstack-infra | 12:31 | |
| *** Thelo has quit IRC | 12:32 | |
| *** [1]Thelo is now known as Thelo | 12:32 | |
| *** niska has joined #openstack-infra | 12:33 | |
| *** ryanpetrello has joined #openstack-infra | 12:36 | |
| *** Jeffrey4l has joined #openstack-infra | 12:38 | |
| *** thiagop has joined #openstack-infra | 12:39 | |
| *** Daisy has quit IRC | 12:39 | |
| *** rhallisey has joined #openstack-infra | 12:39 | |
| *** AJaeger has joined #openstack-infra | 12:39 | |
| *** Daisy has joined #openstack-infra | 12:39 | |
| *** thorst_ has joined #openstack-infra | 12:39 | |
| *** |-paul-| has quit IRC | 12:40 | |
| *** msuriar has joined #openstack-infra | 12:40 | |
| *** chlong has joined #openstack-infra | 12:40 | |
| *** greghaynes has joined #openstack-infra | 12:40 | |
| *** Daisy has quit IRC | 12:41 | |
| *** Daisy has joined #openstack-infra | 12:41 | |
| *** dguitarbite has joined #openstack-infra | 12:41 | |
| *** vgridnev has quit IRC | 12:42 | |
| *** hashar has joined #openstack-infra | 12:42 | |
| openstackgerrit | Alexey Ovchinnikov proposed openstack-infra/project-config: [WIP] Add publishing capability to buildimage-lxd job https://review.openstack.org/290418 | 12:44 |
| *** gildub has quit IRC | 12:44 | |
| *** yamamoto has joined #openstack-infra | 12:45 | |
| *** vgridnev has joined #openstack-infra | 12:45 | |
| *** baoli has joined #openstack-infra | 12:46 | |
| *** Daisy has quit IRC | 12:47 | |
| *** yamamoto has quit IRC | 12:47 | |
| openstackgerrit | Ivan Kolodyazhny proposed openstack-infra/project-config: Add gate job for Cinder Functional tests https://review.openstack.org/287115 | 12:47 |
| *** gnuoy_ has joined #openstack-infra | 12:48 | |
| *** Daisy has joined #openstack-infra | 12:48 | |
| *** yamamoto has joined #openstack-infra | 12:48 | |
| AJaeger | fungi, pabelanger : 5893 jobs currently use ubuntu-trusty, 188 still to go. Some of those are fixed with open patches. | 12:48 |
| *** doug-fish has quit IRC | 12:48 | |
| *** deepakcs has quit IRC | 12:51 | |
| *** gnuoy_ has quit IRC | 12:52 | |
| *** lezbar__ has joined #openstack-infra | 12:52 | |
| *** lezbar has quit IRC | 12:53 | |
| *** Daisy has quit IRC | 12:53 | |
| *** yamamoto has quit IRC | 12:53 | |
| *** baoli_ has joined #openstack-infra | 12:53 | |
| openstackgerrit | Davanum Srinivas (dims) proposed openstack-infra/devstack-gate: Generate a log with deprecation warnings https://review.openstack.org/289901 | 12:56 |
| *** baoli has quit IRC | 12:56 | |
| *** krtaylor has quit IRC | 13:02 | |
| *** dims has quit IRC | 13:05 | |
| *** dims_ has joined #openstack-infra | 13:05 | |
| hashar | sobersabre: sorry was busy this morning. I have approved https://review.openstack.org/#/c/199547/ | 13:05 |
| hashar | sobersabre: I should do some JJB reviewing :-( the queue is pilling | 13:06 |
| hashar | off / commute | 13:06 |
| *** markvoelker_ has joined #openstack-infra | 13:08 | |
| *** gchung has joined #openstack-infra | 13:09 | |
| *** edmondsw has joined #openstack-infra | 13:10 | |
| *** dims_ has quit IRC | 13:10 | |
| *** markvoelker has quit IRC | 13:11 | |
| openstackgerrit | Valeriy Ponomaryov proposed openstack-infra/project-config: Move Manila experimental job to check pipeline https://review.openstack.org/290475 | 13:13 |
| openstackgerrit | Merged openstack-infra/jenkins-job-builder: Add support for credentials properties in authorization matrix https://review.openstack.org/199547 | 13:13 |
| *** dims has joined #openstack-infra | 13:14 | |
| *** thiagop is now known as thiagop-afk | 13:14 | |
| *** dprince has joined #openstack-infra | 13:14 | |
| openstackgerrit | Merged openstack-infra/devstack-gate: Run tests in venv https://review.openstack.org/289969 | 13:15 |
| *** pblaho has joined #openstack-infra | 13:15 | |
| *** jaosorior has quit IRC | 13:15 | |
| *** jaosorior has joined #openstack-infra | 13:15 | |
| *** placko_ has joined #openstack-infra | 13:16 | |
| *** hashar has quit IRC | 13:16 | |
| *** yamamoto has joined #openstack-infra | 13:17 | |
| *** yamamoto has quit IRC | 13:17 | |
| *** weshay has joined #openstack-infra | 13:19 | |
| *** yamamoto has joined #openstack-infra | 13:19 | |
| *** _amrith_ is now known as amrith | 13:20 | |
| *** markvoelker_ has quit IRC | 13:20 | |
| *** annegentle has joined #openstack-infra | 13:22 | |
| *** thiagop-afk is now known as thiagop | 13:24 | |
| *** annegentle has quit IRC | 13:24 | |
| *** annegentle has joined #openstack-infra | 13:25 | |
| *** _nadya_ has quit IRC | 13:25 | |
| *** annegentle has quit IRC | 13:26 | |
| openstackgerrit | Ivan Kolodyazhny proposed openstack-infra/project-config: Add gate job for Cinder Functional tests https://review.openstack.org/287115 | 13:26 |
| *** annegentle has joined #openstack-infra | 13:26 | |
| *** scheuran has quit IRC | 13:28 | |
| *** lucas-hungry is now known as lucasagomes | 13:28 | |
| *** doug-fish has joined #openstack-infra | 13:29 | |
| *** penguinolog has quit IRC | 13:29 | |
| *** _nadya_ has joined #openstack-infra | 13:30 | |
| *** doug-fish has quit IRC | 13:31 | |
| *** annegentle has quit IRC | 13:31 | |
| *** doug-fish has joined #openstack-infra | 13:32 | |
| pabelanger | AJaeger: sure, I have to run an errand in 30mins, but can help land them when I get back | 13:33 |
| *** Mmike has quit IRC | 13:34 | |
| *** Mmike has joined #openstack-infra | 13:34 | |
| AJaeger | pabelanger: whenever you have time ;) yolanda reviewed them already (thanks!) | 13:35 |
| *** links has quit IRC | 13:35 | |
| openstackgerrit | Ivan Kolodyazhny proposed openstack-infra/project-config: Add gate job for Cinder Functional tests https://review.openstack.org/287115 | 13:36 |
| AJaeger | fungi, pabelanger: I think we should write a short mail about the ubuntu-trusty change and drafted the following: https://etherpad.openstack.org/p/x6b4O50uQR | 13:37 |
| AJaeger | could you review, rewrite - and comment whether it's worth sending out this heads-up, please? | 13:37 |
| openstackgerrit | Alexey Stepanov proposed openstack-infra/project-config: Add Python 3.4 PEP8 tests for fuel-qa https://review.openstack.org/290493 | 13:39 |
| *** markvoelker has joined #openstack-infra | 13:39 | |
| *** asilenkov_ has quit IRC | 13:41 | |
| *** pkarikh has quit IRC | 13:41 | |
| *** rakhmerov has quit IRC | 13:41 | |
| *** katyafervent_awa has quit IRC | 13:41 | |
| *** HeOS_ has quit IRC | 13:41 | |
| *** kzaitsev_ws has quit IRC | 13:41 | |
| *** dteselkin has quit IRC | 13:41 | |
| *** tsufiev has quit IRC | 13:41 | |
| *** kzaitsev_mb has quit IRC | 13:41 | |
| *** igormarnat has quit IRC | 13:41 | |
| *** _nadya_ has quit IRC | 13:42 | |
| *** vgridnev has quit IRC | 13:43 | |
| e0ne | AJaeger: I've updated my patch but still can't find why 'zuul' job check fails :( | 13:43 |
| e0ne | AJaeger: I'm sorry if my questions are too stupid:( | 13:44 |
| *** vgridnev has joined #openstack-infra | 13:44 | |
| AJaeger | e0ne: The answers from engineering are co | 13:45 |
| AJaeger | e0ne: wrong pasto ;( | 13:45 |
| *** hashar has joined #openstack-infra | 13:45 | |
| AJaeger | e0ne: gate-cinder-tox-db-functional-mysql != The answers from engineering are co | 13:45 |
| AJaeger | e0ne: gate-cinder-tox-db-functional-mysql != gate-cinder-tox-db-{envlist} with envlist=functional | 13:45 |
| AJaeger | remove the -mysql from layout.yaml | 13:46 |
| e0ne | AJaeger: thanks, I'm trying to do it | 13:46 |
| *** ddieterly has joined #openstack-infra | 13:46 | |
| openstackgerrit | Alexey Stepanov proposed openstack-infra/project-config: Add Python 3.4 PEP8 tests for fuel-qa https://review.openstack.org/290493 | 13:47 |
| *** zhurong_ has quit IRC | 13:48 | |
| *** keedya has joined #openstack-infra | 13:50 | |
| *** notnownikki has joined #openstack-infra | 13:51 | |
| openstackgerrit | Ivan Kolodyazhny proposed openstack-infra/project-config: Add gate job for Cinder Functional tests https://review.openstack.org/287115 | 13:52 |
| e0ne | AJaeger: I removed '-mysql' suffix, but it didn't help | 13:53 |
| openstackgerrit | Merged openstack-infra/shade: Allow passing project_id to create_network https://review.openstack.org/288166 | 13:53 |
| openstackgerrit | Mikhail S Medvedev proposed openstack-infra/project-config: Allow ciwatch-release to push merge commits https://review.openstack.org/283665 | 13:53 |
| *** amotoki has joined #openstack-infra | 13:54 | |
| openstackgerrit | Mikhail S Medvedev proposed openstack-infra/project-config: Allow ciwatch-release to push merge commits https://review.openstack.org/283665 | 13:54 |
| AJaeger | e0ne: let'S see what error jenkins produces, will check later... | 13:55 |
| *** akshai has joined #openstack-infra | 13:55 | |
| anteaya | mmedvede: why do you want ciwatch to push merge commits? | 13:55 |
| *** salv-orlando has quit IRC | 13:55 | |
| mmedvede | anteaya: because we have a feature branch that needs merging to/from master at some point | 13:56 |
| *** yamamoto has quit IRC | 13:56 | |
| anteaya | why did you create a feature branch rather than just merging to master? | 13:56 |
| *** yamamoto has joined #openstack-infra | 13:57 | |
| mmedvede | anteaya: the feature branch is to add unit tests, and it requires some refactoring, so lots of moving things around | 13:58 |
| openstackgerrit | Thomas Herve proposed openstack-infra/project-config: Use VPN devstack plugin in heat jobs https://review.openstack.org/259463 | 13:58 |
| anteaya | ah okay, I can accept that | 13:58 |
| anteaya | most times push merge is just a recipe for self maiming | 13:58 |
| anteaya | but I'm supportive of adding unit tests | 13:58 |
| mmedvede | anteaya: I am still not in ciwatch-release group though, so I either need to get added, or ask for infra-core to submit merges | 13:58 |
| *** markvoelker has quit IRC | 13:58 | |
| *** automagically_ has joined #openstack-infra | 13:59 | |
| anteaya | um, you'll have to bring that item up with fungi | 13:59 |
| anteaya | I have no say in that | 13:59 |
| *** exploreshaifali has quit IRC | 14:00 | |
| *** HeOS has quit IRC | 14:01 | |
| *** automagically_ has left #openstack-infra | 14:01 | |
| mmedvede | anteaya: what did you mean by 'recipe for self-maiming' ? I know that merges can get tricky if not done right - is that what you mean? Or is it something particular to how gerrit does it? | 14:02 |
| anteaya | merges can get tricky if not done right | 14:02 |
| anteaya | which is why we don't have push merge on repos by default | 14:03 |
| *** dtardivel has joined #openstack-infra | 14:03 | |
| *** daemontool_ has joined #openstack-infra | 14:03 | |
| mmedvede | I should be careful then :) | 14:04 |
| anteaya | I hope so | 14:04 |
| openstackgerrit | yolanda.robla proposed openstack/diskimage-builder: Generate fedora-atomic images using dib https://review.openstack.org/287167 | 14:04 |
| *** ddieterly has quit IRC | 14:04 | |
| *** amitgandhinz has joined #openstack-infra | 14:05 | |
| *** kgiusti has joined #openstack-infra | 14:05 | |
| anteaya | mmedvede: I'd like to give fungi an opportunity to read backscroll and say something on this topic before I review | 14:05 |
| anteaya | so it doesn't get in if he would rather it didn't | 14:05 |
| *** daemontool has quit IRC | 14:07 | |
| *** HeOS has joined #openstack-infra | 14:07 | |
| *** salv-orlando has joined #openstack-infra | 14:07 | |
| *** pradk has quit IRC | 14:08 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/system-config: Add a playbook and script for doing adhoc puppet https://review.openstack.org/284352 | 14:08 |
| openstackgerrit | Monty Taylor proposed openstack-infra/system-config: Update for ansible and puppet apply https://review.openstack.org/247099 | 14:08 |
| fungi | AJaeger: i made a few minor additions/corrections but looks great--thanks for writing that! | 14:09 |
| mmedvede | anteaya: Definitely. Note that 283665 should have been done when feature branch was created. Feature branch is meaningless without being able to merge it back | 14:09 |
| anteaya | mmedvede: true | 14:09 |
| *** rlandy has joined #openstack-infra | 14:09 | |
| anteaya | and here is fungi now, able to say something if he wants | 14:09 |
| e0ne | AJaeger: hm.. it works on gate, but fails on my env now :( | 14:09 |
| fungi | well, i'm still catching up on everything that happened while i was helplessly unconscious | 14:12 |
| *** rakhmerov has joined #openstack-infra | 14:12 | |
| anteaya | or walking the dreamtime as I like to think of it | 14:13 |
| fungi | mmedvede: how far along is the feature branch? are you needing changes from master merged into it, or is it ready to be merged back into master? | 14:13 |
| mmedvede | fungi: right now I need to update feature branch from master | 14:14 |
| *** salv-orlando has quit IRC | 14:14 | |
| mmedvede | it is not yet ready to get merged back to master | 14:14 |
| *** gongysh has joined #openstack-infra | 14:14 | |
| *** kevinsho_ has joined #openstack-infra | 14:14 | |
| mmedvede | fungi: I could cherry-pick, but merge seems better | 14:14 |
| *** katyafervent_awa has joined #openstack-infra | 14:16 | |
| *** pkarikh has joined #openstack-infra | 14:16 | |
| mmedvede | fungi: so it would be great if I can get added to ciwatch-release for the period of working on that feature branch. | 14:16 |
| *** fifieldt has quit IRC | 14:16 | |
| *** nelsnelson has joined #openstack-infra | 14:17 | |
| *** dteselkin has joined #openstack-infra | 14:18 | |
| *** nelsnels_ has quit IRC | 14:18 | |
| *** jpr1 has quit IRC | 14:18 | |
| *** asilenkov has joined #openstack-infra | 14:19 | |
| *** _ari_ has joined #openstack-infra | 14:19 | |
| *** mriedem has joined #openstack-infra | 14:19 | |
| *** mtanino has quit IRC | 14:19 | |
| *** igormarnat has joined #openstack-infra | 14:19 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/system-config: Update for ansible and puppet apply https://review.openstack.org/247099 | 14:20 |
| *** gongysh has quit IRC | 14:20 | |
| *** xyang1 has joined #openstack-infra | 14:21 | |
| *** christian_ has joined #openstack-infra | 14:21 | |
| therve | It looks like the new saml2 release breaks kilo | 14:22 |
| therve | Anyone else seeing that? | 14:22 |
| *** NobodyCa1 is now known as NobodyCam | 14:23 | |
| *** tsufiev has joined #openstack-infra | 14:23 | |
| *** moravec has quit IRC | 14:23 | |
| *** _nadya_ has joined #openstack-infra | 14:24 | |
| *** nikhil_k has joined #openstack-infra | 14:24 | |
| fungi | mmedvede: you've familiarized yourself with the merge workflows (into and out of the feature branch) at http://docs.openstack.org/infra/manual/drivers.html#feature-branches ? | 14:24 |
| *** rfolco has quit IRC | 14:25 | |
| *** gongysh has joined #openstack-infra | 14:25 | |
| mmedvede | fungi: yes, it seemed the one difference from non-gerrit merge workflow is to remember to add change-id to merge commit | 14:25 |
| anteaya | therve: I have not seen that myself, no | 14:26 |
| anteaya | therve: have you a log file with an error that is indicative of the failure? | 14:26 |
| therve | anteaya, http://logs.openstack.org/66/278466/8/check/gate-heat-dsvm-functional-orig-mysql-lbaasv1/26b4f7d/logs/apache/keystone.txt.gz | 14:27 |
| fungi | mmedvede: right, commit-generating commands like merge or revert don't call commit hooks, so the commit hook to add the change-id header never fires | 14:27 |
| fungi | mmedvede: worse, there is no equivalent hook for those commands, so you're stuck with commit --amend | 14:27 |
| fungi | as basically a no-op to make sure the hook fires | 14:28 |
| *** rfolco has joined #openstack-infra | 14:28 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/system-config: Add a playbook and script for doing adhoc puppet https://review.openstack.org/284352 | 14:28 |
| openstackgerrit | Monty Taylor proposed openstack-infra/system-config: Update for ansible and puppet apply https://review.openstack.org/247099 | 14:28 |
| mmedvede | or just manually adding the id (it can be generated) | 14:28 |
| fungi | yeah, you could make one up | 14:28 |
| anteaya | therve: so this is the error? ImportError: No module named future.backports.urllib.parse | 14:28 |
| fungi | though that's slightly more error-prone | 14:28 |
| therve | anteaya, Yes | 14:28 |
| *** moravec has joined #openstack-infra | 14:29 | |
| therve | Looks like this module: https://pypi.python.org/pypi/future | 14:30 |
| *** asettle has joined #openstack-infra | 14:30 | |
| anteaya | therve: logstash knows about one hit with that message in the last 7 days | 14:30 |
| therve | I must be the unlucky one | 14:30 |
| anteaya | :( | 14:31 |
| therve | The lib was released today though | 14:31 |
| mmedvede | fungi: otherwise I am very familiar with doing complex merges in git | 14:31 |
| openstackgerrit | Reinhard Tartler proposed openstack-infra/jenkins-job-builder: Add support for disable-strict-forbidden-file-verification https://review.openstack.org/240360 | 14:31 |
| anteaya | it is possible that logstash hasn't parsed errors from today | 14:31 |
| fungi | mmedvede: as for being in ciwatch-release, be extra careful not to use blanket commands that might push dirty workdir states with stray merges in them, extra local tags, et cetera, since gerrit is no longer going to prevent you from doing so | 14:31 |
| anteaya | mriedem: therve is tracking an error that (s)he believes affects kilo | 14:31 |
| therve | anteaya, There is another one here: http://logs.openstack.org/72/287272/1/gate/gate-heat-dsvm-functional-orig-mysql-lbaasv1/d983d31/logs/apache/keystone.txt.gz | 14:32 |
| mriedem | therve: if you suspect a dependency release that breaks things, | 14:32 |
| mriedem | therve: you can run this https://github.com/openstack/requirements/blob/master/tools/what-broke.py | 14:32 |
| mriedem | that dumps the last 2 weeks of dependency releases for things in global-requirements | 14:33 |
| anteaya | mriedem: awesome! | 14:33 |
| *** ddieterly has joined #openstack-infra | 14:33 | |
| therve | mriedem, Oh it seems to be very clearly a pysaml2 release | 14:34 |
| mriedem | therve: yeah https://pypi.python.org/pypi/pysaml2 | 14:34 |
| mriedem | definitely | 14:34 |
| mmedvede | fungi: ok, I would be careful | 14:34 |
| *** nmagnezi has quit IRC | 14:34 | |
| mriedem | therve: have you reported an issue against pysaml2? | 14:34 |
| therve | I wonder if it affects other branches though | 14:34 |
| therve | No not yet | 14:34 |
| mriedem | pysaml2 is uncapped in kilo g-r https://github.com/openstack/requirements/blob/stable/kilo/global-requirements.txt#L120 | 14:34 |
| mmedvede | fungi: and would request to get removed from the group as soon as I am no longer need superpowers | 14:35 |
| mriedem | so that's why we're picking it up | 14:35 |
| *** asettle has quit IRC | 14:35 | |
| therve | Ah yeah it is now | 14:35 |
| mriedem | therve: we don't use that in liberty b/c of upper-constraints https://github.com/openstack/requirements/blob/stable/liberty/upper-constraints.txt#L237 | 14:35 |
| *** gongysh has quit IRC | 14:35 | |
| mriedem | we're using 4.0.0 in liberty runs | 14:35 |
| therve | mriedem, So we should cap in kilo? Or change upper-constraints? | 14:36 |
| therve | I'll start by opening the issue | 14:36 |
| openstackgerrit | Merged openstack-infra/project-config: Allow ciwatch-release to push merge commits https://review.openstack.org/283665 | 14:36 |
| mriedem | therve: we probably cap in kilo | 14:36 |
| *** penguinolog has joined #openstack-infra | 14:36 | |
| mriedem | pysaml2<4.0.4 | 14:36 |
| mriedem | however, that may not fix the issue for us | 14:37 |
| therve | Why not? | 14:37 |
| anteaya | fungi: thanks | 14:39 |
| anteaya | mmedvede: congratulations | 14:39 |
| mriedem | therve: oh nvm, i think it should | 14:39 |
| mriedem | i was thinking futures pulled in pysaml2, but it's the other way around | 14:39 |
| mmedvede | fungi: anteaya: thank you :) | 14:39 |
| therve | mriedem, Also, future not futures :) | 14:39 |
| mriedem | oh right | 14:40 |
| openstackgerrit | Thomas Herve proposed openstack/requirements: Cap pysaml2 https://review.openstack.org/290540 | 14:41 |
| therve | Merging that heat kilo branch turns out to be quite the roller coaster | 14:41 |
| mriedem | thanks for opening https://github.com/rohe/pysaml2/issues/320 | 14:42 |
| *** Daisy has joined #openstack-infra | 14:43 | |
| *** gongysh has joined #openstack-infra | 14:44 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/system-config: Update for ansible and puppet apply https://review.openstack.org/247099 | 14:44 |
| openstackgerrit | Monty Taylor proposed openstack-infra/system-config: Update for ansible and puppet apply https://review.openstack.org/247099 | 14:46 |
| mriedem | therve: weird, i don't even see the future import in here https://github.com/rohe/pysaml2/blob/e82c319d834ba3b1f5660b7c11de20186b09ff8a/src/saml2/sigver.py | 14:46 |
| mriedem | this has to be the breaking change https://github.com/rohe/pysaml2/commit/c78a93298c1c4d6063eaad4ad036ce281631d882 | 14:47 |
| openstackgerrit | Monty Taylor proposed openstack-infra/system-config: Update for ansible and puppet apply https://review.openstack.org/247099 | 14:47 |
| *** markvoelker has joined #openstack-infra | 14:48 | |
| therve | mriedem, How did you end up in the commit? | 14:48 |
| clarkb | kozhukalov: the test runner should set up.additional dbs if necessary | 14:48 |
| therve | mriedem, https://github.com/rohe/pysaml2/blob/master/src/saml2/sigver.py#L18 has it | 14:48 |
| mriedem | therve: was checking the commit history on pysaml2 | 14:48 |
| mriedem | "Slowly moving from six to future.backports" | 14:48 |
| therve | I meant the one at https://github.com/rohe/pysaml2/blob/e82c319d834ba3b1f5660b7c11de20186b09ff8a/src/saml2/sigver.py | 14:49 |
| *** nwkarsten has joined #openstack-infra | 14:49 | |
| penguinolog | Hi! Could anybody help with review: https://review.openstack.org/#/c/290493/ - I'm newbie and not sure, that all is correct. Main goal of this test - codestyle check at situation, where current dependencies does not allows to use Python 3.x. | 14:49 |
| openstackgerrit | Tomas Bezdek proposed openstack-infra/jenkins-job-builder: slack notifications on repeated failure https://review.openstack.org/290545 | 14:49 |
| *** sdake_ has joined #openstack-infra | 14:50 | |
| *** Daisy has quit IRC | 14:51 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/system-config: Update for ansible and puppet apply https://review.openstack.org/247099 | 14:51 |
| *** mriedem is now known as mriedem_meeting | 14:52 | |
| *** sdake has quit IRC | 14:53 | |
| *** bnemec has joined #openstack-infra | 14:53 | |
| *** cloudtrainme has joined #openstack-infra | 14:54 | |
| *** Daisy has joined #openstack-infra | 14:55 | |
| clarkb | penguinolog: so you expect that job to fail until some time in the future when your deps are py3k compatible? | 14:56 |
| clarkb | penguinolog: I wonder if that is better off not running on every patchset | 14:57 |
| openstackgerrit | Monty Taylor proposed openstack-infra/system-config: Update for ansible and puppet apply https://review.openstack.org/247099 | 14:57 |
| clarkb | penguinolog: in any case you have told zuul to run a job but that job does not exiat in jenkins (this is why testing -1'd it) | 14:57 |
| clarkb | penguinolog: you will need to add this new job in jenkins/jobs/ in addition to telling zuul to run it | 14:58 |
| *** sdake has joined #openstack-infra | 14:58 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/system-config: Update for ansible and puppet apply https://review.openstack.org/247099 | 14:58 |
| anteaya | flaper87: I see that the glance core gerrit group includes a bot: https://review.openstack.org/#/admin/groups/13,members | 14:59 |
| *** cloudtrainme has quit IRC | 14:59 | |
| penguinolog | clarkb, I expect, that currently (patchsets are ready) we should fix all code in current branch and protect from breakage, later we should fix whole external dependencies and then enable pytho34 template | 14:59 |
| anteaya | flaper87: I feel this is unusual | 15:00 |
| *** xarses_ has quit IRC | 15:00 | |
| *** sdake_ has quit IRC | 15:00 | |
| anteaya | flaper87: can you help me understand why? | 15:00 |
| frickler | maybe some infra-core could review https://review.openstack.org/288461 it is a patch to add devstack-logs publisher to chef-cookbooks integration checks, so that we can avoid dumping everything into the console log | 15:00 |
| flaper87 | anteaya: it does include a bot. I own the keys and password for that bot. It's just the username we use to handle stalled patches. I feel it's unfair, stats wise, to use my username for that when it's a bot doing the job. | 15:01 |
| *** gongysh has quit IRC | 15:01 | |
| *** cloudtrainme has joined #openstack-infra | 15:01 | |
| anteaya | what is it doing that it is handling stalled patches? what action is it taking? | 15:02 |
| *** kencjohnston has joined #openstack-infra | 15:03 | |
| dmsimard | mnaser: o/ | 15:03 |
| *** vgridnev has quit IRC | 15:03 | |
| *** zz_dimtruck is now known as dimtruck | 15:03 | |
| *** Daisy has quit IRC | 15:04 | |
| dmsimard | Looks like the Vexxhost VMs have 2GB of swap, we have some hacks in to uniformize the swap across different providers, i.e, https://github.com/openstack-infra/devstack-gate/blob/master/functions.sh#L316-L363 | 15:04 |
| penguinolog | clarkb, I seen project-config/jenkins/jobs/python-jobs.yaml: L36: 'gate-{name}-tox-{envlist}' - is it enough? In my changeset I'm using this template-based name | 15:05 |
| dhellmann | does "You must put some 'source' URIs in your sources.list " mean anything to anyone as an error when installing packages? The pbr build is seeing that on patches that shouldn't be changing any of its dependencies http://logs.openstack.org/51/285251/1/check/gate-pbr-installation-dsvm/be107dc/console.html.gz | 15:05 |
| esikachev | hey folks! i have a problem with my local ci. need trigger job by timer (see https://review.openstack.org/#/c/288015/7/config/zuul/layout.yaml), but job not triggered:( can you help me? | 15:05 |
| dmsimard | I'll add a case to ensure if there is swap and it is less than 8GB, to add a swapfile with the diff in size to make up for the missing swap. | 15:06 |
| dmsimard | (just fyi) | 15:06 |
| openstackgerrit | Monty Taylor proposed openstack-infra/system-config: Update for ansible and puppet apply https://review.openstack.org/247099 | 15:06 |
| *** mtanino has joined #openstack-infra | 15:06 | |
| clarkb | penguinolog: you can use that template but you have to instantiate it in jjb | 15:06 |
| anteaya | dhellmann: I am not familiar with that error | 15:07 |
| *** BigWillie has joined #openstack-infra | 15:07 | |
| *** pblaho has quit IRC | 15:08 | |
| clarkb | penguinolog: basically all zuul does is trigger a job that must exist somewhere and that job doesnt exist yet | 15:08 |
| clarkb | dhellmann: sounds like bad apt config? | 15:08 |
| *** sc68cal has joined #openstack-infra | 15:08 | |
| *** cschwede has quit IRC | 15:08 | |
| *** sigmavirus24_awa is now known as sigmavirus24 | 15:09 | |
| dhellmann | clarkb : is that an image issue? I didn't do anything to change it, so I'm not sure how apt ends up getting configured on our test nodes | 15:09 |
| openstackgerrit | Davanum Srinivas (dims) proposed openstack-infra/devstack-gate: Generate a log with deprecation warnings https://review.openstack.org/289901 | 15:09 |
| mordred | dhellmann: we no longer have deb-src urls | 15:09 |
| mordred | dhellmann: because we do not mirror the deban source packages | 15:09 |
| openstackgerrit | Ryan Hallisey proposed openstack-infra/tripleo-ci: Allow the continer job to run again https://review.openstack.org/288915 | 15:09 |
| *** pradk has joined #openstack-infra | 15:09 | |
| mordred | dhellmann: I believe lifeless or Nakato have a patch up to fix that for pbr | 15:09 |
| mordred | dhellmann: https://review.openstack.org/#/c/289689/1/tools/integration.sh | 15:10 |
| mordred | dhellmann: but that has landed already ... | 15:10 |
| pabelanger | AJaeger: back, reviewing your patches now | 15:10 |
| *** tonytan4ever has joined #openstack-infra | 15:11 | |
| mordred | dhellmann: oh- that's check queue - rebase on master and try again? | 15:11 |
| dhellmann | mordred : yeah, I just reached the same conclusion, thanks | 15:12 |
| mordred | woot1 | 15:12 |
| therve | mordred, The build is 10 days old :) | 15:12 |
| mordred | therve: that's 100 years in gate years | 15:12 |
| openstackgerrit | Tomas Bezdek proposed openstack-infra/jenkins-job-builder: slack notifications on repeated failure https://review.openstack.org/290545 | 15:12 |
| clarkb | no need to rebase | 15:12 |
| clarkb | just recheck | 15:12 |
| therve | That I know. Trying to merge on kilo is archaeology | 15:12 |
| mordred | clarkb: it's check | 15:12 |
| clarkb | mordred: correct | 15:13 |
| openstackgerrit | Doug Hellmann proposed openstack-dev/pbr: clean up default tox env list https://review.openstack.org/285251 | 15:13 |
| openstackgerrit | Doug Hellmann proposed openstack-dev/pbr: add --format option to info command https://review.openstack.org/285250 | 15:13 |
| mordred | clarkb: check doesn't merge, it tests as uploaded | 15:13 |
| *** rbrndt_ has joined #openstack-infra | 15:13 | |
| clarkb | mordred: that isnt true | 15:13 |
| mordred | oh? | 15:13 |
| clarkb | check is merged to target branch first | 15:13 |
| pabelanger | fungi: AJaeger: going to approve some more bindep migration changes for JJB. Around now to monitor | 15:13 |
| mordred | nevermind then | 15:13 |
| *** Daisy has joined #openstack-infra | 15:14 | |
| clarkb | the idea being its the state we will be in when we merge so test that | 15:14 |
| mordred | clarkb: but that's not the idea | 15:14 |
| mordred | clarkb: that's what the gate does | 15:14 |
| mordred | merging with the state master is in at the time the change is uploaded is a meaningless operation for anything other than checking current mergability | 15:15 |
| clarkb | it is not | 15:15 |
| mordred | since master is almost certain to have moved on by the time it hits gate | 15:15 |
| *** tonytan4ever has quit IRC | 15:15 | |
| clarkb | you very often fail in an updated merge state | 15:15 |
| mordred | competely and utter useless | 15:15 |
| mordred | it tests nothing | 15:15 |
| clarkb | or pass after fixes merge | 15:15 |
| mordred | k | 15:15 |
| clarkb | it is not usrlesss... | 15:15 |
| mordred | I mean | 15:15 |
| mordred | it's not important to argue | 15:15 |
| mordred | we do the thing already | 15:15 |
| clarkb | and it is how zuul has worked since zuul was a thing | 15:15 |
| *** tonytan4ever has joined #openstack-infra | 15:15 | |
| mordred | I'm mostly arguing about "the idea being its the state we will be in when we merge so test that" | 15:16 |
| mordred | which is inaccurate | 15:16 |
| mordred | but that's me being pedantic | 15:16 |
| clarkb | it is closer to that state | 15:16 |
| mordred | yes. it is closer to that state | 15:16 |
| clarkb | as master moves you want to test against that | 15:16 |
| mordred | but it is not that state | 15:16 |
| clarkb | because fixes go in and changes are made that git merge might get badly wronf | 15:16 |
| clarkb | (common with yaml) | 15:16 |
| mordred | yes. I undersatnd what you're saying | 15:16 |
| mordred | I'm just saying - it is NOT the target state that will land | 15:17 |
| mordred | that's the gate | 15:17 |
| *** zeih has joined #openstack-infra | 15:17 | |
| mordred | it is a potentially useful state to test | 15:17 |
| penguinolog | clarkb, sorry, I don't see any job files, which is directly follows aliases in this tree. Coult you point me on any, as example? Thank you! | 15:17 |
| clarkb | right but you shouodnt need to wait for two hans and a computer to catch it | 15:17 |
| clarkb | catch it early if you can | 15:17 |
| mordred | clarkb: sure. I'm conceding | 15:17 |
| mordred | I'm just saying it's not the target state | 15:18 |
| mordred | it's a state | 15:18 |
| clarkb | penguinolog: jenkins/jobs/projects.yaml should have plenty of examples | 15:18 |
| *** ddieterly is now known as ddieterly[away] | 15:18 | |
| clarkb | mordred: also thus exact case is one use case | 15:18 |
| *** Daisy has quit IRC | 15:19 | |
| mordred | clarkb: sure. I'm conceding | 15:19 |
| clarkb | you dont need a rebase to get valid results | 15:19 |
| mordred | I'm just saying it's not the target state | 15:19 |
| clarkb | ok | 15:19 |
| fungi | flaper87: if it's just doing abandon or workflow -1, any objection to setting up a specific acl permission and group for it? a bot account with mass approval permission seems like a bad precedent | 15:21 |
| *** tsg has joined #openstack-infra | 15:21 | |
| openstackgerrit | Merged openstack-infra/project-config: Add publisher devstack-logs for chef integration https://review.openstack.org/288461 | 15:21 |
| openstackgerrit | Merged openstack-infra/project-config: Use ubuntu-trusty for check-osc-plugins https://review.openstack.org/289843 | 15:21 |
| *** tsg has quit IRC | 15:21 | |
| fungi | dhellmann: mordred: i believe Nakato has a patch up to replace the previous use of apt-get build-dep in pbr tests | 15:21 |
| *** zeih has quit IRC | 15:21 | |
| fungi | nevermind, you also said that | 15:22 |
| flaper87 | fungi: no objections at all. That's exactly what it's doing. It first -1's the patch and notifies the author and a then abandons the patch. | 15:22 |
| * fungi reminds himself to read all scrollback before responding | 15:22 | |
| flaper87 | fungi: thanks for the heads up, that sounds like a better option | 15:22 |
| flaper87 | fungi: u doing that? Or should I do it through the gerrit dashboard ? | 15:23 |
| fungi | flaper87: i'll write you a patch for that--any other repos besides glance? glanceclient? | 15:23 |
| flaper87 | fungi: glance_store | 15:23 |
| fungi | cool, i'll have it up momentarily for you to look over | 15:23 |
| flaper87 | fungi: thanks a lot | 15:23 |
| anteaya | flaper87 fungi thank you | 15:23 |
| anteaya | yes I feel core reviewers should be humans | 15:24 |
| openstackgerrit | Monty Taylor proposed openstack-infra/system-config: Update for ansible and puppet apply https://review.openstack.org/247099 | 15:24 |
| anteaya | and there are options for bot actions | 15:24 |
| flaper87 | anteaya: tbh, I agree but I honestly didn't know there was a better way to give permissions to a bot and I don't remember if I asked or not but I'd assume I didn't, otherwise I'd have known :D | 15:25 |
| flaper87 | anteaya: thanks for bringing this up :) | 15:26 |
| *** gnuoy_ has joined #openstack-infra | 15:26 | |
| openstackgerrit | Merged openstack-infra/project-config: periodic-{name}-{python}-with-oslo-master: ubuntu-trusty https://review.openstack.org/290352 | 15:26 |
| *** nwkarsten has quit IRC | 15:27 | |
| *** nwkarsten has joined #openstack-infra | 15:28 | |
| fungi | flaper87: not on glance-specs then? | 15:28 |
| openstackgerrit | Monty Taylor proposed openstack-infra/system-config: Update for ansible and puppet apply https://review.openstack.org/247099 | 15:28 |
| sobersabre | fdegir: hi man. are you around to look at https://review.openstack.org/#/c/287497/ ? very trivial patch to better support google cloud storage plugin in jjb? | 15:28 |
| anteaya | flaper87: sure, glad we found a good option | 15:29 |
| flaper87 | fungi: nope, glance-specs is done manually by the PTL | 15:29 |
| *** vgridnev has joined #openstack-infra | 15:29 | |
| openstackgerrit | Merged openstack-infra/project-config: Use ubuntu-trusty for pylint jobs https://review.openstack.org/290362 | 15:29 |
| openstackgerrit | Merged openstack-infra/project-config: Use ubuntu-trusty for salt-lint https://review.openstack.org/290372 | 15:29 |
| sobersabre | waynr: ping on https://review.openstack.org/#/c/287497/ | 15:30 |
| openstackgerrit | Merged openstack-infra/project-config: astara-appliance-buildimage: Use ubuntu-trusty https://review.openstack.org/290093 | 15:30 |
| *** vgridnev has quit IRC | 15:30 | |
| *** gnuoy_ has quit IRC | 15:31 | |
| AJaeger | pabelanger: thanks for reviewing. Did you see the etherpad link with my email? Is that good to go? | 15:31 |
| *** placko_ has quit IRC | 15:32 | |
| sobersabre | hashar: thanks for merging https://review.openstack.org/#/c/199547/ | 15:32 |
| hashar | sobersabre: you are welcome :) | 15:32 |
| *** jpr has joined #openstack-infra | 15:32 | |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/project-config: Add a glance-reviewbot group https://review.openstack.org/290589 | 15:32 |
| fungi | flaper87: anteaya: ^ | 15:32 |
| openstackgerrit | Merged openstack-infra/project-config: Convert javascript jobs to use ubuntu-trusty https://review.openstack.org/290368 | 15:33 |
| *** xarses_ has joined #openstack-infra | 15:33 | |
| *** tmorin has joined #openstack-infra | 15:34 | |
| anteaya | fungi: thank you | 15:34 |
| tmorin | hi everyone | 15:34 |
| *** vgridnev has joined #openstack-infra | 15:35 | |
| tmorin | I'd need some help to delete an ununused branch in a project | 15:35 |
| *** vgridnev has quit IRC | 15:35 | |
| sobersabre | hashar: do you mind looking at another one in the same direction ? adding 1 new xml attribute to google cloud storage, with tests, and 1 +2 already ? | 15:35 |
| tmorin | could someone provide help on that ? | 15:35 |
| sobersabre | hashar: https://review.openstack.org/#/c/287497/ | 15:36 |
| anteaya | tmorin: what project and what branch? | 15:36 |
| tmorin | the project is networking-bgpvpn, and the branch is "stable/kilo" | 15:36 |
| anteaya | tmorin: and what is the git sha for the tip of the branch | 15:36 |
| tmorin | anteaya: e2230ef86fbf73d6b31817ca23a640522650819d | 15:36 |
| anteaya | mriedem_meeting: ^^ does stable have a policy on when branches for stable/kilo can be deleted? | 15:36 |
| hashar | sobersabre: I am in meetings for the rest of day sorry :( | 15:36 |
| pabelanger | AJaeger: I did, I added some comments about bindep too | 15:37 |
| sobersabre | hashar: hm... you can delegate to someone else :) | 15:37 |
| tmorin | anteaya: the branch had been created before it was properly identified we shouldn't work on a backport in a branch called "stable/foo" | 15:37 |
| fungi | tmorin: also, most official projects following stable branch policy push a signed tag like "kilo-eol" to the branch before it's deleted. is there a reason to preserve that branch state and indicate it's reached end of life, or was it a branch which never should have existed in the first place? | 15:37 |
| *** krtaylor has joined #openstack-infra | 15:37 | |
| pabelanger | AJaeger: we don't need to include it. More of a heads up about bindep in general | 15:37 |
| AJaeger | pabelanger: let's not add this paragraph now - we need to solve some questions first before we can talk about other-requirements.txt | 15:37 |
| tmorin | fungi: this branch has never had any real use | 15:37 |
| *** infra-red has quit IRC | 15:37 | |
| fungi | tmorin: okay, thanks. i can delete it for you | 15:38 |
| tmorin | fungi: "should have never existed in the first place" | 15:38 |
| tmorin | fungi: thanks | 15:38 |
| AJaeger | pabelanger: That's more for the followup announcement - thanks, I'll send it out then. | 15:38 |
| *** annegentle has joined #openstack-infra | 15:38 | |
| tmorin | fungi: and it has been misleading people looking for our kilo backport (which lives in branch backport/kilo) | 15:38 |
| pabelanger | AJaeger: works for me | 15:38 |
| sobersabre | warpc: fdegir: are you around ? | 15:39 |
| sobersabre | hm | 15:39 |
| sobersabre | waynr: fdegir are you around ? | 15:39 |
| sobersabre | zxiiro: hi. maybe you can help? | 15:39 |
| warpc | sobersabre: hi! | 15:39 |
| fdegir | sobersabre: how may I help? | 15:40 |
| fungi | tmorin: i've deleted the stable/kilo branch of openstack/networking-bgpvpn which was previously at the e2230ef86fbf73d6b31817ca23a640522650819d commit | 15:40 |
| *** ildikov has quit IRC | 15:40 | |
| sobersabre | fdegir: I posted update to google cloud storage jjb plugin: https://review.openstack.org/#/c/287497/ | 15:40 |
| fdegir | sobersabre: thanks, will take a look | 15:40 |
| sobersabre | fdegir: it updates the code to support the latest version of the plugin (which added a very nice feature I hope to be using without cherry-picking ) | 15:40 |
| tmorin | fungi: many thanks ! | 15:40 |
| *** mriedem_meeting is now known as mriedem | 15:40 | |
| AJaeger | thanks, pabelanger ! | 15:41 |
| mordred | clarkb, jeblair: so - I have just recently learned something about glance images that is one of the most insane things yet | 15:41 |
| *** esikachev has quit IRC | 15:41 | |
| sobersabre | fdegir: you can now strip off a leading part of path you're uploading, which is very very very handy. | 15:41 |
| mordred | you're relaly going to love this one | 15:41 |
| jeblair | nibalizer, yolanda: see https://review.openstack.org/270329 ; exim already has a manual, i'm not going to rewrite it in our puppet | 15:41 |
| *** tmorin has left #openstack-infra | 15:41 | |
| *** sdake_ has joined #openstack-infra | 15:41 | |
| *** sdake has quit IRC | 15:41 | |
| zxiiro | sobersabre: I'm Thanh. already +2 your patch so nothing else I can do ;) | 15:41 |
| *** esikachev has joined #openstack-infra | 15:41 | |
| mriedem | anteaya: the short answer is kilo is planned to be eol on 2016/5/2 per http://releases.openstack.org/ | 15:42 |
| mordred | clarkb, jeblair: there are magical properties which control hypervisor behavior when booting the image that end-users may or may not know about and may or may not be allowed to set, but which may or may not affect performance of the image | 15:42 |
| *** gchung is now known as gordc | 15:42 | |
| fungi | dougwig: you're our neutron liaison, right? just a heads up that i removed the stable/kilo branch of networking-bgpvpn at tmorin's request (it can be recreated easily right now if you need) | 15:42 |
| anteaya | mriedem: thank you | 15:42 |
| sobersabre | zxiiro: yep, I'm trying to bug everyone involved - maybe they know someone I don't :) | 15:42 |
| mriedem | anteaya: i'm going to have a session at the summit about eol for stable branches though | 15:42 |
| sobersabre | zxiiro: thanks for +2 | 15:42 |
| mordred | clarkb, jeblair: which could lead to such thing as "the workload we run in the image we upload runs slower than in the images from the provider" | 15:42 |
| mriedem | anteaya: so we can try and doc some policy around that | 15:42 |
| anteaya | mriedem: sounds riviting | 15:42 |
| anteaya | mriedem: should I get my ticket now? | 15:42 |
| fungi | anteaya: with enough coffee, i'm sure it will be | 15:42 |
| anteaya | ha ha ha | 15:42 |
| anteaya | mriedem: thank you | 15:42 |
| fungi | at least that's how i plan to survive the hour | 15:43 |
| mriedem | oh come on | 15:43 |
| fungi | ;) | 15:43 |
| mriedem | i can try to think of some way to jazz it up | 15:43 |
| fungi | dancing bears | 15:43 |
| anteaya | ha ha ha | 15:43 |
| anteaya | my morning visual | 15:43 |
| fungi | i think irinic might have some we could borrow | 15:43 |
| mriedem | yeah, i was thinking circus performers of some sort | 15:43 |
| fungi | er, ironic | 15:43 |
| clarkb | mordred awesome | 15:43 |
| dmsimard | How would I test a change to devstack-gate without potentially breaking everything ? Does the gate jobs for devstack-gate actually use the review patchset to set up stuff ? | 15:44 |
| clarkb | dmsimard: yes it is fully self testing | 15:44 |
| *** zeih has joined #openstack-infra | 15:44 | |
| dmsimard | clarkb: ok cool, just making sure. thanks. | 15:44 |
| *** Swami has joined #openstack-infra | 15:45 | |
| fungi | clarkb: dmsimard: to a point anyway. it does run itself in some common devstack-gate based job variants, but it doesn't verify that every d-g using job under the sun still works | 15:45 |
| nibalizer | jeblair: my point was not to have you document exim | 15:46 |
| dmsimard | fungi, clarkb: I want to modify fix_disk_layout to fix another inconsistency brought by the new Vexxhost VMs | 15:46 |
| mriedem | therve: https://pypi.python.org/pypi/pysaml2/4.0.5 | 15:46 |
| nibalizer | just give a breadcrumb of what the datastructure you were expecing the user to pass in | 15:46 |
| dmsimard | before that, VMs either had 8GB of swap or they didn't have any, Vexxhost has 2GB. | 15:46 |
| mriedem | so we should just blacklist 4.0.4 in stable/kilo g-r | 15:46 |
| fungi | dmsimard: yeah, that's probably well exercised in our testing | 15:46 |
| dmsimard | fungi: cool. | 15:46 |
| therve | mriedem, WIll that work? The new dependency is somewhat bad on kilo anyway, no? | 15:46 |
| mriedem | therve: did we have a launchpad bug for that pysaml2 issue? | 15:46 |
| therve | I didn't file one no | 15:47 |
| mriedem | therve: bad in that g-r doesn't list the future package? | 15:47 |
| *** ddieterly[away] is now known as ddieterly | 15:47 | |
| fungi | dmsimard: however, what that won't test is some of the projects which run d-g based jobs and use a lot of ram for various reasons, so it may not exercise the effect of trying to run with only 2gb of swap (or were you thinking of adding a 6gb swapfile as a second device to augment it?) | 15:47 |
| therve | mriedem, Well yeah. Plus we don't really want to install something new, do we? | 15:47 |
| clarkb | dmsimard: fungi correct we dont have full branch coverage but we do use a checkout of the proposed change when running those tests | 15:47 |
| jeblair | nibalizer: i think all of the input values (not just for that structure) are basically just exim config options, so i imagined a user would need to consult the manual to do anything, and that was implied. what are you looking for then? | 15:48 |
| mriedem | therve: hmm, good point | 15:48 |
| pabelanger | dmsimard: just confirming, your looking into the swap issue in 290337 apevec reported? | 15:48 |
| dmsimard | pabelanger: yeah. | 15:48 |
| pabelanger | great | 15:48 |
| dmsimard | fungi, clarkb: I'll add something to add a sparse swapfile (like the 8GB one we create). The size of the swapfile will be equal to the amount missing. | 15:48 |
| *** nwkarsten has quit IRC | 15:48 | |
| clarkb | pabelanger: dmsimard is there a case where 2gb swap is insufficient? | 15:48 |
| AJaeger | dougwig, mestery : Could either of you review https://review.openstack.org/#/c/290397, please ? This fixes a fallout from the constraints changes, it again blocks python34 testing on kilo for neutron | 15:48 |
| *** zeih has quit IRC | 15:49 | |
| pabelanger | clarkb: I am not sure, I was CC'd on 290337 asking about a swap difference between clouds | 15:49 |
| pabelanger | clarkb: I haven't really looked into why that is yet | 15:49 |
| *** nwkarsten has joined #openstack-infra | 15:49 | |
| dmsimard | clarkb: we're pushing the boundaries of what we can do within 8GB. That 8GB of swap across all VMs have worked well for us until we hit Vexxhost VMs. | 15:49 |
| clarkb | dmsimard: there is an argumebt that the fix is to constrain the test not add more swap but I lost that a couple months back re magnum | 15:50 |
| AJaeger | could another project-config core merge https://review.openstack.org/#/c/290397, please? This fixes a fallout from the constraints changes, it again blocks python34 testing on kilo for neutron. Thanks! | 15:50 |
| dmsimard | clarkb: We already set VMs to 8GB of swap in fix_disk_layout, this is just to bring Vexxhost in line. | 15:50 |
| dmsimard | We already have three different scenarios (jobs split to run within memory limits) for both packstack and puppet-openstack | 15:51 |
| pabelanger | AJaeger: looking | 15:51 |
| clarkb | jeblair: nibalizer aiui the idea is to document the data structure in puppet? in this case a list of list of list of list? | 15:51 |
| dmsimard | We don't want to split too much, feels innefficient | 15:51 |
| nibalizer | jeblair: most of the other file is 'put value from user into config file' | 15:51 |
| nibalizer | this is 'unpack array of hashes of hashes, then switch on a boolean' | 15:51 |
| openstackgerrit | Merged openstack-infra/puppet-exim: Accept configurable routers/transports https://review.openstack.org/270329 | 15:51 |
| nibalizer | um and it merged? | 15:51 |
| *** esikachev has quit IRC | 15:52 | |
| clarkb | dmsimard: ya it is fine to bring in line, mostly trying to figure out where our hard requirements are | 15:52 |
| AJaeger | anteaya: pabelanger: Thanks! | 15:52 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-exim: Revert "Accept configurable routers/transports" https://review.openstack.org/290608 | 15:53 |
| *** Qiming has quit IRC | 15:53 | |
| nibalizer | mordred: jeblair https://review.openstack.org/#/c/290608/ so we can continue the discussion, if you don't mind | 15:53 |
| jeblair | nibalizer: yep. happy to do so, and if we resolve that something should be added, i'll write the patch. | 15:53 |
| jeblair | nibalizer: i still don't understand what would be useful, or why this is different from any other puppet module. | 15:54 |
| fungi | clarkb: dmsimard: i've been thinking for a while that d-g automatically activating swap for jobs is to their detriment. wonder if we should leave the function there for jobs to call if they know they need swap (and maybe make it create a preallocated swapfile regardless of where it runs, for better consistency)? | 15:54 |
| nibalizer | i guess part of it is my own inexperience with exim | 15:54 |
| *** tonytan_brb has joined #openstack-infra | 15:54 | |
| nibalizer | but im looking pretty hard at this exim manual and not getting any clue what I should pass in to transports | 15:54 |
| clarkb | fungi: that would self identify jobs that potentially expose other problems too (memory bloat etc) | 15:55 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Convert *plugin-jobs to ubuntu-trusty https://review.openstack.org/290348 | 15:55 |
| jeblair | nibalizer: anything in http://www.exim.org/exim-html-current/doc/html/spec_html/ch-generic_options_for_transports.html | 15:55 |
| nibalizer | and i think the idea is that if you want a single-line configuration you pass a key,value with 'value' set to true ? | 15:55 |
| *** tonytan4ever has quit IRC | 15:55 | |
| jeblair | yeah | 15:55 |
| *** kmartin has joined #openstack-infra | 15:55 | |
| jeblair | nibalizer: so is that the info you're looking for? | 15:55 |
| dmsimard | I don't particularly have an opinion, I know for a fact that we took pretty good steps into minimizing memory usage.. going as far as hardcoding a low amount of workers for each service, splitting project tests across different jobs | 15:55 |
| nibalizer | but the 'true' gets dropped ya? not written to the file? | 15:55 |
| clarkb | dmsimard: it is often openstacks fault | 15:56 |
| dmsimard | clarkb: agreed | 15:56 |
| clarkb | dmsimard: we have had bad memory regressions in the past that were largely igbored due to abundance of memory | 15:56 |
| nibalizer | jeblair: yea that part is what really sticks out at me as something that is in the puppet-module, not something that is in in the exim docs | 15:56 |
| fungi | clarkb: indeed, remember when this all worked in 2gb ram? | 15:57 |
| clarkb | fungi: so long ago | 15:57 |
| jeblair | nibalizer: okay. i'm certain that we have not documented things like this in other modules, but i'm happy to have the improved standard start with this module, as long as we continue to improve it to this level everywhere. :) | 15:58 |
| openstackgerrit | David Shrewsbury proposed openstack-infra/shade: Use network in neutron_available_floating_ips https://review.openstack.org/280178 | 15:58 |
| nibalizer | jeblair: woot ok | 15:58 |
| openstackgerrit | Matt Riedemann proposed openstack/requirements: kilo: pin pysaml2<4.0.4 https://review.openstack.org/290613 | 15:58 |
| openstackgerrit | Merged openstack-infra/project-config: Don't run python34 job for neutron/kilo https://review.openstack.org/290397 | 15:58 |
| nibalizer | sorry to be wet blanket | 15:58 |
| mriedem | therve: https://review.openstack.org/#/c/290613/ | 15:59 |
| jeblair | nibalizer: no prob. patch forthcoming. | 15:59 |
| *** regXboi has joined #openstack-infra | 15:59 | |
| *** Sukhdev has joined #openstack-infra | 15:59 | |
| *** nwkarsten has quit IRC | 15:59 | |
| *** nwkarsten has joined #openstack-infra | 16:00 | |
| openstackgerrit | Merged openstack-infra/project-config: Add a glance-reviewbot group https://review.openstack.org/290589 | 16:00 |
| fungi | clarkb: some updated jjb runtimes for you (the ones which completed after i lost consciousness last night): jenkins02 274m54s (finally hit proxy error, i've resumed it), jenkins03 179m15s, jenkins06 39m57s, jenkins07 44m2s | 16:00 |
| *** HeOS has quit IRC | 16:00 | |
| fungi | clarkb: also, for completeness, i'm going to update the gearman plugin on jenkins.o.o now unless you object | 16:01 |
| openstackgerrit | David Shrewsbury proposed openstack-infra/shade: Use network in neutron_available_floating_ips https://review.openstack.org/280178 | 16:01 |
| AJaeger | now only 144 jobs that use bare-trusty | 16:01 |
| *** Kaiyan has joined #openstack-infra | 16:01 | |
| clarkb | fungi: go for it | 16:02 |
| *** _ari_ has quit IRC | 16:02 | |
| waynr | sobresabre I am around, but working at $dayjob so i don't have much attention to spare until tonight probably | 16:02 |
| *** _ari_ has joined #openstack-infra | 16:02 | |
| fungi | with its infrequent load, this will go much faster | 16:02 |
| openstackgerrit | Monty Taylor proposed openstack-infra/ansible-puppet: Add flag to skip posting to logs https://review.openstack.org/290617 | 16:02 |
| anteaya | jeblair: I'm great with increased documenation across modules | 16:02 |
| mordred | nibalizer, clarkb, fungi, jeblair, yolanda: ^^ mind reviewing/landing that for me? | 16:02 |
| *** zzzeek has quit IRC | 16:03 | |
| anteaya | I also have had problems understanding how to use modules with current documentation | 16:03 |
| *** thorst_ is now known as thorst_afk | 16:03 | |
| *** slogan_r_ has joined #openstack-infra | 16:03 | |
| openstackgerrit | James E. Blair proposed openstack-infra/puppet-exim: Add documentation for exim routers/transports https://review.openstack.org/290620 | 16:03 |
| jeblair | nibalizer, mordred, yolanda: ^ | 16:04 |
| *** nwkarsten has quit IRC | 16:04 | |
| nibalizer | mordred: why does that break launch_node? | 16:04 |
| *** zzzeek has joined #openstack-infra | 16:04 | |
| Kaiyan | Hi All I have a review https://review.openstack.org/#/c/286179/ about setting monasca persister to only run monasca tempest tests in check/gate job. This is a small change only related to monasca gate job. If anyone get a chance to look at it and +2 it that will be great! Thank you! | 16:05 |
| nibalizer | jeblair: thank you | 16:05 |
| jeblair | nibalizer: thank you; sorry for the misunderstanding | 16:05 |
| mordred | nibalizer: so - I'm working on making shade-launch-node use remote_puppet ansible | 16:05 |
| nibalizer | mordred: i think thats great | 16:06 |
| mordred | nibalizer: but I'm also making it operate by UUID | 16:06 |
| mordred | because if you are, for instance, launching a review.o.o replacement | 16:06 |
| nibalizer | jeblair: me too, im glad we worked it out | 16:06 |
| jeblair | ++ | 16:06 |
| mordred | you wnat to make sure that you're operating on the actual thing you're booting | 16:06 |
| mordred | nibalizer: something about all of that leads to: | 16:06 |
| mordred | TASK [puppet : set log filename] *********************************************** | 16:06 |
| mordred | fatal: [c5725905-83ae-4d6d-8bc1-d75a016cca35]: FAILED! => {"failed": true, "msg": "No last item, sequence was empty."} | 16:06 |
| *** HeOS has joined #openstack-infra | 16:07 | |
| openstackgerrit | Valeriy Ponomaryov proposed openstack-infra/project-config: Remove redundant Manila Tempest job https://review.openstack.org/290623 | 16:08 |
| pabelanger | AJaeger: if you are ready, we can pull the trigger on 289848 | 16:08 |
| nibalizer | mordred: so we're using ansible_fqdn | 16:08 |
| pabelanger | AJaeger: that is the database tox change | 16:08 |
| slogan_r_ | Could someone please add me to the following groups: https://review.openstack.org/#/admin/groups/1297,members, 1298, 1301, and 1302? | 16:09 |
| slogan_r_ | apologies if I should be asking elsewhere | 16:09 |
| nibalizer | could we use {{ ansible_fqdn | default(ansible_ssh_hostname) }} or so? | 16:09 |
| fungi | jeblair: not sure if you saw my comment last night, but when you have a moment you probably want to weigh in on http://lists.openstack.org/pipermail/openstack-dev/2016-March/088641.html since "make zuul support atomic cross-repo dependencies" is how the horizon team has figured they should solve xstatic dependency updates | 16:09 |
| *** yamahata has joined #openstack-infra | 16:10 | |
| anteaya | slogan_r_: can you link to the patch that created those groups please? | 16:11 |
| mordred | nibalizer: hrm. | 16:11 |
| mordred | nibalizer: actually - good catch - it has nothing to do with uuid at all | 16:11 |
| *** zeih has joined #openstack-infra | 16:11 | |
| slogan_r_ | anteaya: looking | 16:11 |
| slogan_r_ | and thanks | 16:11 |
| anteaya | well I can't do anything as I dont' have gerrit admin permissions | 16:11 |
| anteaya | but anyone who does will need to see the patch | 16:11 |
| nibalizer | ya its probably failing on shell: "ls -tr /var/lib/puppet/reports/{{ ansible_fqdn }}/*_puppetdb.json" | 16:12 |
| slogan_r_ | anteaya: by patch do you mean the gerrit review or something else? | 16:13 |
| mordred | nibalizer: ls /var/lib/puppet/reports/testlaunchnode.openstack.org | 16:13 |
| mordred | 201603091548.yaml | 16:13 |
| *** infra-red has joined #openstack-infra | 16:13 | |
| mordred | nibalizer: I'm guessing because the puppetdb log output thing hasn't been installed yet? | 16:13 |
| openstackgerrit | Ivan Kolodyazhny proposed openstack-infra/project-config: Add gate job for Cinder Functional tests https://review.openstack.org/287115 | 16:14 |
| slogan_r_ | https://review.openstack.org/#/c/282365/ | 16:14 |
| anteaya | slogan_r_: the gerrit review | 16:14 |
| mordred | nibalizer: since that would get installed by the puppet run itself? | 16:14 |
| slogan_r_ | see above :-) | 16:14 |
| *** sdake has joined #openstack-infra | 16:14 | |
| nibalizer | as long as it has system-config it should be pulling in the report | 16:14 |
| nibalizer | but if we don't have the config set it won't use it | 16:14 |
| nibalizer | reports=puppetdb_file is what we want in puppet.conf | 16:15 |
| anteaya | slogan_r_: we need to add the owner of the patch to those groups | 16:15 |
| slogan_r_ | anteaya: right, that's fine. He can then add me later | 16:15 |
| fungi | mordred: clarkb: are we close to being able to switch to dib for devstack-trusty images in rackspace with the latest shade release? | 16:15 |
| slogan_r_ | and https://review.openstack.org/#/c/282365/ | 16:15 |
| nibalizer | mordred: which we should be albe to do/are doing with the ansible-puppet-config stuff that yolanda and I worked on | 16:15 |
| anteaya | I'm guessing you are Syd Logan | 16:15 |
| anteaya | slogan_r_: yes | 16:15 |
| slogan_r_ | that's me! | 16:15 |
| mordred | nibalizer: http://paste.openstack.org/show/489867/ | 16:15 |
| *** zeih has quit IRC | 16:15 | |
| clarkb | fungi: I think the plan was to just switch to ubuntu-trusty | 16:15 |
| mordred | nibalizer: there is the ansible run | 16:15 |
| *** sdake_ has quit IRC | 16:15 | |
| anteaya | slogan_r_: yup, so our policy is to add the owner of a patch as the first member to new groups | 16:15 |
| clarkb | fungi: and considering how that has gone for bare-* probably assuming that there are no new regressions on that | 16:15 |
| mordred | nibalizer: reports=store,puppetdb | 16:16 |
| slogan_r_ | makes sense | 16:16 |
| mordred | nibalizer: is what's in puppet.conf | 16:16 |
| anteaya | slogan_r_: then they can add others | 16:16 |
| slogan_r_ | adding him is perfectly fine | 16:16 |
| clarkb | fungi: we cannot switch to devstack-trusty dib on rax without more work due to the networking situation in rax | 16:16 |
| mordred | nibalizer: oh - wait - that's in [master[ | 16:16 |
| fungi | clarkb: oh, right, we need simple-init/glean in the devstack images to do that | 16:16 |
| anteaya | slogan_r_: avoids us getting in the middle if there is a rift in a group | 16:16 |
| mordred | nibalizer: [user] | 16:16 |
| mordred | reports=puppetdb_file | 16:16 |
| clarkb | fungi: the version of cloud init on those images won't configure rax VMs properly | 16:16 |
| nibalizer | mordred: so do you have manage_config set | 16:16 |
| anteaya | slogan_r_: so hopefully a gerrit admin will happen by and add you | 16:16 |
| slogan_r_ | seems like the only rationale policy | 16:16 |
| Kaiyan | @Clark Boylan Thank you! | 16:16 |
| anteaya | slogan_r_: if not ask again tomorrow | 16:16 |
| slogan_r_ | ok | 16:16 |
| mordred | nibalizer: yes | 16:17 |
| anteaya | slogan_r_: thanks for understanding | 16:17 |
| nibalizer | it looks like you are setting up config | 16:17 |
| *** sdake_ has joined #openstack-infra | 16:17 | |
| mordred | nibalizer: yup | 16:17 |
| slogan_r_ | anteaya. np | 16:17 |
| slogan_r_ | and thanks | 16:17 |
| nibalizer | mordred: got an ip? | 16:17 |
| anteaya | :) | 16:17 |
| mordred | nibalizer: is the report plugin itself not installed by ansible-puppet? | 16:17 |
| mordred | nibalizer: don't we install that with puppet? | 16:17 |
| slogan_r_ | anteaya: just posting here is enough? | 16:17 |
| anteaya | slogan_r_: yup, that and patience | 16:17 |
| anteaya | slogan_r_: if you have to post again tomorrow, bring the url of the gerrit patch | 16:18 |
| mordred | nibalizer: I think we're setting config properly but are not installing the ./modules/openstack_project/lib/puppet/reports/puppetdb_file.rb file until we run puppet | 16:18 |
| nibalizer | mordred: the report plugin is in a lib/ directory of a module (system-config) so it should be autoloaded | 16:18 |
| mordred | ah | 16:18 |
| mordred | hrm | 16:18 |
| nibalizer | i think if you turn on all the debugging at the beginning of a run you can see it say 'YO I found a thing, pluginsyncing' | 16:18 |
| mordred | nibalizer: 23.253.99.18 | 16:18 |
| *** asettle has joined #openstack-infra | 16:19 | |
| *** Kaiyan has quit IRC | 16:19 | |
| *** sdake has quit IRC | 16:19 | |
| *** nwkarsten has joined #openstack-infra | 16:19 | |
| openstackgerrit | Ryan Hallisey proposed openstack-infra/tripleo-ci: Allow the continer job to run again https://review.openstack.org/288915 | 16:19 |
| mordred | nibalizer: I'm going to abandon the above ansible-puppet patch | 16:20 |
| nibalizer | Debug: Processing report from testlaunchnode.openstack.org with processor Puppet::Reports::Puppetdb_file | 16:20 |
| clarkb | slogan_r_: anteaya where is the change for broadview-ui? | 16:20 |
| clarkb | slogan_r_: anteaya broadview-collector is done | 16:20 |
| *** BigWillie has quit IRC | 16:20 | |
| jeblair | fungi: thanks. mordred just responded. i'm going to let his response stand because what i was going to write isn't nearly as productive. | 16:20 |
| fungi | heh | 16:21 |
| anteaya | clarkb: https://review.openstack.org/#/c/283101/ | 16:21 |
| slogan_r_ | clarkb: https://review.openstack.org/#/c/282365/ | 16:21 |
| slogan_r_ | oh | 16:21 |
| *** sdake_ is now known as sdake | 16:21 | |
| *** infra-re_ has joined #openstack-infra | 16:21 | |
| * slogan_r_ posted for collector, oops | 16:21 | |
| *** roxanagh_ has joined #openstack-infra | 16:21 | |
| openstackgerrit | Matt Riedemann proposed openstack/requirements: kilo: pin pysaml2<4.0.4 https://review.openstack.org/290613 | 16:21 |
| anteaya | slogan_r_: is there more than -collector and -ui? | 16:22 |
| clarkb | slogan_r_: anteaya all done, the initial member can add more group members | 16:22 |
| slogan_r_ | nope | 16:22 |
| anteaya | slogan_r_: great | 16:22 |
| nibalizer | mordred: im gonna try something | 16:22 |
| anteaya | clarkb: wonderful, thank you | 16:22 |
| slogan_r_ | thanks! both of you | 16:22 |
| *** asettle has quit IRC | 16:23 | |
| *** infra-red has quit IRC | 16:23 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/ansible-puppet: Don't post reports if there are no reports to post https://review.openstack.org/290633 | 16:24 |
| mordred | nibalizer: cool. also ^^ | 16:24 |
| rcarrillocruz | hmm | 16:24 |
| rcarrillocruz | i've seen "Could not parse for environment production: invalid byte sequence in US-ASCII at /home/jenkins/workspace/gate-system-config-puppet-syntax/modules/openstack_project/manifests/lists.pp" in at least 3 changes today that had nothing to do with lists | 16:24 |
| *** slogan_r_ has left #openstack-infra | 16:24 | |
| anteaya | wasn't there an ascii converstion discussion yesterday in channel? | 16:25 |
| anteaya | I guess I didn't need both conversation and discussion in that question | 16:26 |
| Clint | i thought you meant conversion | 16:26 |
| rcarrillocruz | if there was i missed it, i'll check logs, thx | 16:26 |
| clarkb | rcarrillocruz: actually I think it does have to do with lists | 16:26 |
| clarkb | rcarrillocruz: we have non ascii in that file | 16:26 |
| openstackgerrit | Ivan Kolodyazhny proposed openstack-infra/project-config: Add non-voting job for Cinder Functional tests https://review.openstack.org/287115 | 16:26 |
| anteaya | Clint: maybe a meant conversion? | 16:26 |
| anteaya | Clint: would I have sounded more knowledgeable on the topic if I said conversion? | 16:27 |
| rcarrillocruz | clarkb: i mean, the changes showing that failure were not about lists... | 16:27 |
| clarkb | rcarrillocruz: probably fallout from switch to ubuntu-trusty | 16:27 |
| Clint | anteaya: possibly! | 16:27 |
| rcarrillocruz | ah | 16:27 |
| nibalizer | mordred: so every puppet run that i've done has created the .json | 16:27 |
| anteaya | then I meant conversion | 16:27 |
| rcarrillocruz | right | 16:27 |
| anteaya | Clint: thanks for reading my mind! | 16:27 |
| * Clint nods. | 16:27 | |
| rcarrillocruz | i glanced AJaeger thread | 16:27 |
| clarkb | rcarrillocruz: we probably need to set LC_ALL=C.utf8 and en_US.utf8 or something .utf8 | 16:27 |
| rcarrillocruz | i'll read ... | 16:27 |
| *** arxcruz has quit IRC | 16:28 | |
| pabelanger | Ya, seems utf8 related | 16:28 |
| *** rossella_s has quit IRC | 16:28 | |
| pabelanger | As an FYI, ubuntu-trusty dibs nolonger setup locale info | 16:28 |
| pabelanger | and its up to the project to handle it | 16:28 |
| pabelanger | see python-swiftclient for an example in tox.ini | 16:29 |
| nibalizer | mordred: so maybe we have some kind of a race condition? | 16:29 |
| clarkb | ya... while it is a bit painful I do think that being explicit in projects about what their tests expect is likely better in the long run | 16:29 |
| dmsimard | clarkb: hmm, it doesn't look like this works: https://github.com/openstack-infra/devstack-gate/commit/43a96301b2f5d0fecd472cfb0e0d3985f377776f | 16:29 |
| pabelanger | clarkb: agree | 16:30 |
| mordred | nibalizer: yah | 16:30 |
| dmsimard | clarkb: looking at the meminfo from several jobs, they have either 2GB swap (vexxhost) or none at all ? | 16:30 |
| *** christian_ has quit IRC | 16:30 | |
| clarkb | will make things more consistent when running tests in places where locale is different and unexpected | 16:30 |
| mordred | nibalizer: I kinda think it's not 100% worth tracking down | 16:30 |
| *** armax has joined #openstack-infra | 16:30 | |
| rcarrillocruz | ah | 16:30 |
| dmsimard | clarkb: I tried running it manually and I get an invalid argument on the swapon | 16:30 |
| clarkb | dmsimard: I am pretty sure it does work, I checked the logs for the builds on that change | 16:30 |
| clarkb | dmsimard: and tests stopped failing | 16:30 |
| mordred | nibalizer: expecially since at this point in launch_node we're not a real node yet anyway, so we probably honestly don't want to post to puppetdb | 16:30 |
| anteaya | dims: any feedback on your codesearch experience lately? | 16:31 |
| clarkb | dmsimard: let me dig up the job logs | 16:31 |
| mordred | nibalizer: (btw - all the rest of this worked -so launchnode bootstrapping with the ansible and whatnot) | 16:31 |
| anteaya | dims: is it working for you? | 16:31 |
| openstackgerrit | Ivan Kolodyazhny proposed openstack-infra/project-config: Add non-voting job for Cinder Functional tests https://review.openstack.org/287115 | 16:31 |
| fungi | clarkb: okay, jenkins.o.o has latest gearman plugin, is restarted and jjb updated on it in 8m12s (it was already fully up to date on its job configs, looks like) | 16:31 |
| dmsimard | clarkb: http://paste.openstack.org/show/489871/ | 16:32 |
| rcarrillocruz | pabelanger, clarkb: http://logs.openstack.org/99/247099/17/check/gate-system-config-puppet-syntax/e6e8756/console.html , this is on system-config tests | 16:32 |
| rcarrillocruz | should I put the stuff on system-config project for locale fix? | 16:32 |
| nibalizer | mordred: the data i'd like to get is the breakdown of resources we apply on first-run, and what failed/changed etc | 16:32 |
| nibalizer | but you're right, not critical | 16:32 |
| * rcarrillocruz goes check python-swiftclient per pabelanger comment | 16:33 | |
| *** dims has quit IRC | 16:33 | |
| mordred | nibalizer: so does 290633 work for you? | 16:33 |
| clarkb | swapon $file is the syntax here | 16:33 |
| anteaya | we seem to have increased "error node launch attempts" on rackspace: http://grafana.openstack.org/dashboard/db/nodepool-rackspace | 16:33 |
| openstackgerrit | Merged openstack-infra/puppet-exim: Add documentation for exim routers/transports https://review.openstack.org/290620 | 16:33 |
| pabelanger | rcarrillocruz: Ya, update tox.ini, and recheck | 16:33 |
| * clarkb trying to find job that ran not on rax | 16:33 | |
| dmsimard | clarkb: http://paste.openstack.org/show/489872/ | 16:34 |
| dmsimard | works with dd, not with fallocate | 16:34 |
| *** sridhar_ram has joined #openstack-infra | 16:34 | |
| *** cloudtrainme has quit IRC | 16:34 | |
| nibalizer | mordred: yah | 16:34 |
| mordred | woot | 16:34 |
| clarkb | dmsimard: what is your filesystem? | 16:34 |
| *** Jeffrey4l has quit IRC | 16:34 | |
| *** harlowja_at_home has joined #openstack-infra | 16:34 | |
| mordred | clarkb, jeblair: thanks for your previos +2 - could I get one on 290633 instead? | 16:35 |
| *** Jeffrey4l has joined #openstack-infra | 16:35 | |
| *** vincentll has quit IRC | 16:35 | |
| clarkb | dmsimard: http://logs.openstack.org/57/278557/1/check/gate-tempest-dsvm-multinode-full/38e9f34/logs/devstack-gate-setup-workspace-new.txt.gz#_2016-02-11_10_33_39_538 and http://logs.openstack.org/57/278557/1/check/gate-tempest-dsvm-multinode-full/38e9f34/logs/screen-dstat.txt.gz tell me it worked | 16:36 |
| openstackgerrit | Ricardo Carrillo Cruz proposed openstack-infra/system-config: Set locale on tox.ini to fix new ubuntu-trusty images https://review.openstack.org/290637 | 16:36 |
| *** bpokorny has joined #openstack-infra | 16:36 | |
| clarkb | dmsimard: apparently fallocate works on ext but not other filesystems | 16:36 |
| anteaya | yolanda: have you had an opportunity to draft up the announcement for the ip change for the gerrit vm upgrade? | 16:36 |
| anteaya | yolanda: I can help if you like, would be great to get that posted today | 16:36 |
| dmsimard | clarkb: it's on centos so probably xfs, let me check | 16:37 |
| dmsimard | clarkb: yeah, xfs. | 16:37 |
| clarkb | dmsimard: thta is why | 16:37 |
| anteaya | yolanda: and obviously spinning up the new vm so we know the ips | 16:37 |
| dmsimard | clarkb: centos7 defaults to xfs | 16:37 |
| clarkb | dmsimard: wow | 16:38 |
| mordred | anteaya: I'm working with yolanda on spinning up the new VM currently | 16:38 |
| clarkb | dmsimard: I guess change it to dd for greater compatibility | 16:38 |
| dmsimard | clarkb: see for example http://logs.openstack.org/37/290337/1/gate/gate-packstack-integration-scenario001-tempest-dsvm-centos7/698145f/logs/diag/meminfo.txt.gz 0 swaptotal | 16:38 |
| clarkb | hopefully that isn't too slow | 16:38 |
| *** placko_ has joined #openstack-infra | 16:38 | |
| dmsimard | from https://review.openstack.org/#/c/290337/ | 16:38 |
| anteaya | mordred: awesome | 16:38 |
| anteaya | mordred yolanda go you! | 16:38 |
| clarkb | dmsimard: right it will fail on xfs | 16:39 |
| mordred | anteaya: also - I know I'm behind and have been in and out recently - but can you tl;dr me the "why are we doing a new gerrit VM"? | 16:39 |
| *** bpokorny has quit IRC | 16:39 | |
| dmsimard | clarkb: yeah the sparse dd was instantaneous | 16:39 |
| *** gyee has joined #openstack-infra | 16:39 | |
| anteaya | gerrit 2.11 spends more time in gc | 16:39 |
| dmsimard | dd from /dev/zero takes.. depending on write speed | 16:39 |
| dmsimard | have to step out for a bit, brb | 16:39 |
| anteaya | mordred: gerrit 2.11 gc causes issues, we want more ram for the jvc | 16:39 |
| clarkb | dmsimard: we cnnot use a sparse file | 16:39 |
| *** bpokorny has joined #openstack-infra | 16:39 | |
| dmsimard | understood | 16:39 |
| clarkb | dmsimard: it breaks hard and makes debugging impossible | 16:39 |
| mordred | anteaya: ah - so this is "get machien with more rams" | 16:40 |
| anteaya | mordred: we want a 60GB vm so we can give at least 30GB for the jvc | 16:40 |
| anteaya | mordred: yes exactly | 16:40 |
| *** MarkAtwood has joined #openstack-infra | 16:40 | |
| mordred | cool | 16:40 |
| anteaya | mordred: 60GB RAM vm please | 16:40 |
| clarkb | dmsimard: theory is that we simultaneously run out of disk and memory which causes the kernel to be very unhappy when it tries to swap to a sparse file | 16:40 |
| openstackgerrit | Doug Hellmann proposed openstack-infra/release-tools: make args to creating stable branch more explicit https://review.openstack.org/289385 | 16:40 |
| openstackgerrit | Doug Hellmann proposed openstack-infra/release-tools: add script to generate branching instructions https://review.openstack.org/289386 | 16:40 |
| * mordred points out that xenial comes out real-soon-now - so if we procrastinated just a bit we could get onto the next LTS ... but then shuts up | 16:40 | |
| anteaya | mordred: we bikeshedded on that in the meeting yesterday | 16:41 |
| mordred | anteaya: neat! | 16:41 |
| anteaya | mordred: if you have time for the logs | 16:41 |
| mordred | anteaya: as long as the color of the shed has been discussed | 16:41 |
| jeblair | the part of jeblair will be played by mordred ;) | 16:41 |
| anteaya | then we coelesed around a 60GB vm | 16:41 |
| anteaya | ha ha ha | 16:41 |
| *** annegentle has quit IRC | 16:41 | |
| jeblair | mordred: everyone seemed comfortable with gerrit staying on trusty for a few years | 16:42 |
| openstackgerrit | Merged openstack-infra/ansible-puppet: Don't post reports if there are no reports to post https://review.openstack.org/290633 | 16:42 |
| mordred | jeblair: darn. so if I'd been here the two of us both could have said "we could just do xenial"? | 16:42 |
| openstackgerrit | Ricardo Carrillo Cruz proposed openstack-infra/system-config: Set locale on tox.ini to fix new ubuntu-trusty images https://review.openstack.org/290637 | 16:42 |
| anteaya | there were more than two | 16:42 |
| jeblair | mordred: and no one wanted to figure out systemd under a time crunch | 16:42 |
| mordred | that's fair | 16:42 |
| anteaya | then zaro spoke up and asked why we were bikeshedding | 16:42 |
| *** annegentle has joined #openstack-infra | 16:42 | |
| anteaya | it was a moment to behold | 16:42 |
| jeblair | there was a really good reason we were having that conversation | 16:42 |
| clarkb | dmsimard: in any case, go ahead and propose the switch to use dd, it will be self testing and we can see how bad the 8GB write is | 16:42 |
| jeblair | it wasn't really bikeshedding | 16:42 |
| mordred | _I_'d like to get all of our servers on to xenial in less than a few years - mainly so that we can go ahead and get systemd over with and not have more than one init system | 16:43 |
| mordred | but I do think that waiting until we can do it in a controlled fashion makes perfect sense | 16:43 |
| jeblair | i think many people do not appreciate the complexity of moving gerrit to a new server | 16:43 |
| mordred | jeblair: DOCKER! | 16:43 |
| anteaya | no, I'm just saying zaro got us back to the discussion of how to fix gc on gerrit | 16:43 |
| mordred | jeblair: (is that the right answer?) | 16:43 |
| jeblair | anteaya: we disagree | 16:43 |
| anteaya | okay | 16:44 |
| jeblair | anteaya: it was *definitely* an important conversation to have | 16:44 |
| jeblair | and not at all a distraction | 16:44 |
| *** dims has joined #openstack-infra | 16:44 | |
| openstackgerrit | Merged openstack/requirements: Block pymongo version 3.1 https://review.openstack.org/290233 | 16:44 |
| anteaya | I'm not saying it wasn't | 16:44 |
| anteaya | I'm saying it was out of character for zaro to speak up like that | 16:44 |
| anteaya | and I thought it was great for him to speak up | 16:44 |
| anteaya | he doesn't usually do that | 16:44 |
| jeblair | okay, i'm not talking about anyone's individual habits | 16:44 |
| jeblair | i'm just saying, it wasn't bikeshedding, and we were not off-topic | 16:45 |
| anteaya | sorry if my point was poorly conveyed | 16:45 |
| anteaya | I'm mis-used the word | 16:45 |
| *** abregman has quit IRC | 16:45 | |
| anteaya | I'm sorry | 16:45 |
| *** mikelk has quit IRC | 16:45 | |
| clarkb | dmsimard: it should be noted that fallocate in general does work on xfs, it apparently does not work as a swapfile | 16:45 |
| *** cloudtrainme has joined #openstack-infra | 16:46 | |
| *** trown has joined #openstack-infra | 16:46 | |
| clarkb | dmsimard: I do not understand all of the intricacies involved in that, but dd'ing a non sparse file appears to be our alternative | 16:46 |
| *** akshai has quit IRC | 16:46 | |
| anteaya | mordred: so if you and yolanda can create a 60GB vm and find out the ipv4 and ipv6 addresses we can draft the announcement to the mailing list | 16:48 |
| mordred | anteaya: yup | 16:48 |
| anteaya | thanks | 16:48 |
| mordred | anteaya: I'm fixing the automation for that | 16:48 |
| anteaya | oh goodness | 16:48 |
| mordred | anteaya: but I expect to be done soon | 16:48 |
| amrith | dhellmann, the change for pymongo merged in g-r, I'm not sure why the trove change won't merge. https://review.openstack.org/#/c/290236/ | 16:48 |
| anteaya | doesn't everyone fixing the automation for that? | 16:48 |
| amrith | am I missing something obvious? | 16:48 |
| mordred | anteaya: yup | 16:49 |
| amrith | it says, 'needs verified' but... | 16:49 |
| mordred | anteaya: I may be being a bit more aggressive with fixing it all the way | 16:49 |
| *** akshai has joined #openstack-infra | 16:49 | |
| *** ferhat has joined #openstack-infra | 16:49 | |
| mordred | Leaving 'diversion of /etc/init/ureadahead.conf to /etc/init/ureadahead.conf.disabled by cloud-init' | 16:49 |
| mordred | wow | 16:49 |
| dhellmann | amrith : try removing and reapplying the workflow flag. it won't happen automatically | 16:49 |
| mordred | I feel like cloud-init tries to be systemd | 16:49 |
| *** e0ne has quit IRC | 16:50 | |
| ferhat | hello all | 16:50 |
| ferhat | I think there is some problem with https://wiki.openstack.org/wiki/Special:OpenIDLogin/ChooseName | 16:50 |
| amrith | sorry dhellmann I'm cross eyed. it is 1m away in zuul to complete. | 16:50 |
| *** yamahata has quit IRC | 16:50 | |
| ferhat | OpenID login integration is not working | 16:50 |
| dhellmann | amrith : oh, so you have the same lack of patience with the CI system that I do? :-) | 16:50 |
| anteaya | mordred: go you | 16:50 |
| mgagne | is there a way to list more than the last 10 jobs on a specific provider? http://status.openstack.org/openstack-health/#/g/node_provider/internap-nyj01 :-/ | 16:50 |
| amrith | dhellmann, no. I'm just cross eyed :) | 16:51 |
| dhellmann | amrith : that I can't help you with, sorry :-) | 16:51 |
| EmilienM | hello infra, can someone approve the "login.defs/redhat: set SYS_UID_MIN and SYS_GID_MIN" patch please ? https://review.openstack.org/#/c/288244/ | 16:51 |
| amrith | yes, the CI is taking a bit longer than usual this morning | 16:51 |
| amrith | thx dhellmann | 16:51 |
| anteaya | mgagne: does changing the period in the period dropdown menu get you what you want? | 16:51 |
| *** IlyaG has joined #openstack-infra | 16:52 | |
| *** wolsen has quit IRC | 16:52 | |
| *** trown is now known as trown|brb | 16:52 | |
| fungi | ferhat: we've temporarily disabled new account creation on wiki.openstack.org while we work out mitigation for some particularly nasty spam/defacement attacks we've been trying to weather | 16:52 |
| *** wolsen has joined #openstack-infra | 16:52 | |
| mgagne | we applied changed yesterday so I would like to get more jobs for today, not yesterday =( | 16:52 |
| anteaya | mgagne: okay well openstack-health is mtreinish's project so perhaps asking him in #openstack-qa might be the way to go | 16:53 |
| mgagne | and no, end date looks to not affect "Recent Runs" section, only graphs | 16:53 |
| fungi | ferhat: apparently login.launchpad.net is no longer effectively deterring spammers from creating accounts to log into things which use it for openid | 16:53 |
| mordred | WOOT | 16:53 |
| anteaya | mgagne: okay thanks | 16:53 |
| mgagne | will ask #openstack-qa | 16:54 |
| *** annegentle has quit IRC | 16:54 | |
| *** annegentle has joined #openstack-infra | 16:55 | |
| *** jaosorior has quit IRC | 16:55 | |
| *** matrohon has quit IRC | 16:56 | |
| *** slogan_r_ has joined #openstack-infra | 16:57 | |
| *** tosky has quit IRC | 16:57 | |
| *** ashleighfarnham has joined #openstack-infra | 17:01 | |
| *** HeOS has quit IRC | 17:02 | |
| *** tonytan_brb has quit IRC | 17:02 | |
| *** tonytan4ever has joined #openstack-infra | 17:02 | |
| *** jlanoux has quit IRC | 17:03 | |
| *** cschwede has joined #openstack-infra | 17:03 | |
| *** fawadkhaliq has joined #openstack-infra | 17:03 | |
| *** binbincong has quit IRC | 17:03 | |
| *** fawadkhaliq has quit IRC | 17:03 | |
| *** nwkarsten has quit IRC | 17:04 | |
| *** piet has joined #openstack-infra | 17:04 | |
| *** nwkarsten has joined #openstack-infra | 17:04 | |
| *** tonytan4ever has quit IRC | 17:05 | |
| openstackgerrit | James E. Blair proposed openstack/gertty: Handle more than one change result when searching https://review.openstack.org/290694 | 17:05 |
| mnaser | hi dmsimard | 17:05 |
| *** tonytan4ever has joined #openstack-infra | 17:05 | |
| pleia2 | good morning | 17:05 |
| mnaser | (many hours later) | 17:05 |
| *** kzaitsev_mb has joined #openstack-infra | 17:05 | |
| *** trown|brb has quit IRC | 17:05 | |
| *** daemontool has joined #openstack-infra | 17:05 | |
| *** ashleigh_ has joined #openstack-infra | 17:06 | |
| anteaya | morning pleia2 | 17:06 |
| *** ashleighfarnham has quit IRC | 17:06 | |
| pleia2 | fungi: yeah, the spam has gotten very bad on launchpad, and the spammers more clever every day, and it's definitely a mechanical turk kind of deal (also pretty sure they were monitoring an Ubuntu channel where we talked about it, they adjusted based on our conversations almost instantly) | 17:06 |
| *** BigWillie has joined #openstack-infra | 17:06 | |
| dhellmann | I'm starting to create stable branches for libraries. Is there anything I need to do in infra to make the test jobs work properly? I feel like there's a place in devstack-gate where we have the branch names? | 17:06 |
| *** jistr has quit IRC | 17:06 | |
| *** daemontool_ has quit IRC | 17:07 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/system-config: Retire old launch-node.py https://review.openstack.org/251063 | 17:07 |
| openstackgerrit | Monty Taylor proposed openstack-infra/system-config: Update for ansible and puppet apply https://review.openstack.org/247099 | 17:07 |
| *** kzaitsev_ws has joined #openstack-infra | 17:07 | |
| anteaya | pleia2: :( | 17:07 |
| clarkb | dhellmann: there is, in devstack-gate/features.yaml we need to add mitaka | 17:07 |
| mordred | jeblair, clarkb, nibalizer, yolanda: ^^ those are ready for review | 17:07 |
| pleia2 | anteaya: yeah, we had to move our discussion to an unlogged channel | 17:07 |
| *** rguillebert has quit IRC | 17:07 | |
| anteaya | pleia2: double :( | 17:07 |
| dhellmann | clarkb : thanks, I'll do that now | 17:08 |
| anteaya | sad on so many levels | 17:08 |
| mordred | I have booted a server using the one updated for puppet apply and it had the success | 17:08 |
| anteaya | yahooooooo | 17:08 |
| anteaya | had to add some ooooo to not infringe on trademark | 17:08 |
| clarkb | dhellmann: and separately from that at some point in the future we need to instruct devstack-gate to use mitaka on old side of upgrades. This tends to happen after all branches are made | 17:08 |
| dhellmann | clarkb : yeah, we probably want to wait to do that until we have server branches | 17:08 |
| jeblair | mordred, clarkb: can you please review this simple change that will make mtreinish happy? | 17:08 |
| *** cloudtra_ has joined #openstack-infra | 17:08 | |
| *** nwkarsten has quit IRC | 17:08 | |
| clarkb | dhellmann: yup | 17:08 |
| jeblair | mordred, clarkb: https://review.openstack.org/277981 | 17:09 |
| *** apoorvad has joined #openstack-infra | 17:09 | |
| *** thorst_afk is now known as thorst_ | 17:09 | |
| *** rcernin has quit IRC | 17:09 | |
| *** esikachev has joined #openstack-infra | 17:09 | |
| dhellmann | clarkb : is there any reason not to go ahead and add ocata to devstack-gate/features.yaml? | 17:09 |
| *** HeOS has joined #openstack-infra | 17:10 | |
| *** fawadkhaliq has joined #openstack-infra | 17:10 | |
| mordred | jeblair: yes! | 17:10 |
| clarkb | dhellmann: probably not, it just won't be used until stable/ocata shows up | 17:10 |
| mtreinish | jeblair: ooh, I do like that change | 17:10 |
| *** jpr has quit IRC | 17:10 | |
| clarkb | dhellmann: so might as well get ahead of the curve | 17:10 |
| *** cloudtrainme has quit IRC | 17:10 | |
| mriedem | anteaya: i just got this when trying to email the mellanox ci email listed in the 3rd party wiki page | 17:10 |
| mriedem | "The group openstack_ci only accepts messages from people in its organization or on its allowed senders list, and your email address isn't on the list." | 17:10 |
| mriedem | anteaya: that seems wrong, right? | 17:10 |
| clarkb | mtreinish: what sort of tags do you need? | 17:10 |
| openstackgerrit | Doug Hellmann proposed openstack-infra/devstack-gate: add mitaka and ocata branches to feature list https://review.openstack.org/290701 | 17:10 |
| dhellmann | clarkb : ^^ | 17:10 |
| *** yamahata has joined #openstack-infra | 17:11 | |
| anteaya | mriedem: hmmmm | 17:11 |
| mriedem | from https://wiki.openstack.org/wiki/ThirdPartySystems/Mellanox_CI | 17:11 |
| clarkb | mtreinish: I just wonder if we are using an arbitrary tag system to paint over missing features in the non arbitrary metadata | 17:11 |
| fungi | mriedem: the alternative is to post to the third-party-announce list which they're all supposed to be monitoring | 17:11 |
| anteaya | mriedem: that isn't the purpose of having an email listed as a contact email for a ci | 17:11 |
| anteaya | mriedem: it seems odd bordering on wrong, yes | 17:11 |
| anteaya | lennyb: are you about? | 17:12 |
| mriedem | fungi: yeah, but i don't want to subscribe to another list... | 17:12 |
| mriedem | so i guess i'll just not pursue it | 17:12 |
| clarkb | dhellmann: commented | 17:12 |
| jeblair | clarkb: mostly to create arbitrary groups of jobs that teams are interested in. like "the qa team is interested in this job" or "postgres" or "stable".... | 17:12 |
| anteaya | mriedem: no no, they need to have an email contact you can use | 17:12 |
| clarkb | jeblair: ah | 17:12 |
| mtreinish | clarkb: it's so we can group periodic jobs instead of putting them in separate pipelines | 17:12 |
| jeblair | clarkb: or neutron, i think was another specific example | 17:12 |
| anteaya | mriedem: not a wall you can knock on to suit yourself | 17:12 |
| openstackgerrit | Doug Hellmann proposed openstack-infra/devstack-gate: add mitaka and ocata branches to feature list https://review.openstack.org/290701 | 17:13 |
| jeblair | clarkb: and ultimately filter on that in the dashboard | 17:13 |
| dhellmann | clarkb : thanks, updated | 17:13 |
| anteaya | mriedem: lennyb is the irc nick of the ci operator for that account, and shows up to meetings regularly | 17:13 |
| anteaya | mriedem: I'm confident I can get to the bottom of this | 17:13 |
| anteaya | he may be asleep at present | 17:13 |
| nibalizer | mordred: for the shade launch node I still don't see any docs, also need an answer on root vs !root | 17:14 |
| jeblair | nibalizer: the docs are updated in the last patch | 17:14 |
| jeblair | nibalizer: https://review.openstack.org/251063 | 17:15 |
| anteaya | mriedem: thanks for bringing it to my attention, leave it with me, I'll get back to you | 17:15 |
| *** asettle has joined #openstack-infra | 17:15 | |
| nibalizer | jeblair: ah ty | 17:15 |
| *** skolekonov is now known as _skolekonov | 17:16 | |
| mriedem | anteaya: thanks | 17:16 |
| fungi | mriedem: also if there is good reason, it's not generally a problem to disable an account that's performing questionably, then get in touch with the maintainer when they're available to look into it before reenabling on our side | 17:16 |
| *** binbincong has joined #openstack-infra | 17:16 | |
| anteaya | fungi: it is a question of recheck syntax | 17:17 |
| fungi | ahh, yeah that's less urgent i guess | 17:17 |
| anteaya | fungi: mriedem had sent them a direct email and had cc'd me | 17:17 |
| anteaya | sorry I didn't say so earlier | 17:17 |
| mordred | nibalizer: oh - look in the follow on patch for docs | 17:17 |
| mriedem | fungi: in this case, it's not that it's a problem, it's that i want to run it on some nova changes | 17:17 |
| fungi | got it | 17:17 |
| jeblair | mordred: nibalizer does raise the point about whether the script needs to be run as root | 17:18 |
| anteaya | the bigger issue is an email that is listed as a contact point but isn't a contact point | 17:18 |
| nibalizer | jeblair: well as someone who has run early drafts of it as non-root, it needs to be run as root | 17:18 |
| mordred | jeblair: yes. although that point doesn't have anything to do with this patch, it is a good point | 17:18 |
| mordred | both launch-node and shade-launch-node now do that rm | 17:19 |
| nibalizer | the problem is unlinking and then running expand-groups | 17:19 |
| mordred | should we add "sudo" to the rm? | 17:19 |
| mordred | or document "run this as room" | 17:19 |
| fungi | nibalizer: mordred: in the past, being able to run the launch script as a non-root user has been helpful | 17:19 |
| fungi | with appropriate read/write permissions added to the appropriate directories on the puppetmaster to support that | 17:19 |
| mordred | fungi: so you would vote for adding sudo to the commands in question? | 17:19 |
| mordred | although that'll make it harder to do the os.unlink | 17:20 |
| nibalizer | making /etc/ansible/hosts group:admin and g+w would be ok i think | 17:20 |
| *** asettle has quit IRC | 17:20 | |
| fungi | mordred: i'd vote first for finding a posix group/perms solution which doesn't require privilege elevation | 17:20 |
| mordred | kk | 17:20 |
| nibalizer | would make editing the emergency file a user task instead of a su- root task | 17:20 |
| nibalizer | or sudo vim | 17:20 |
| fungi | in the past we added our accounts to the puppet group on puppetmaster so we could generate certs, for example | 17:20 |
| jeblair | do we have a known puppet-syntax ubuntu-trusty? locale issue? http://logs.openstack.org/52/284352/4/check/gate-system-config-puppet-syntax/33506c2/console.html | 17:21 |
| jeblair | sorry for extra ? | 17:21 |
| fungi | i don't feel super-strongly about it, but sudo _is_ a bit of a workaround for when it's not really useful to use posix permissions the way they were intended | 17:21 |
| *** Sukhdev has quit IRC | 17:21 | |
| jeblair | i'm ++ on posix groups | 17:22 |
| *** Sukhdev has joined #openstack-infra | 17:22 | |
| *** jcoufal has quit IRC | 17:22 | |
| fungi | jeblair: i believe the ubuntu-minimal element is creating images with the default C.UTF-8 locale rather than en_US.UTF-8 that rackspace used in their images | 17:22 |
| *** daemontool_ has joined #openstack-infra | 17:22 | |
| fungi | which has some implications on, for example, sort order | 17:23 |
| jeblair | fungi: yeah, i was asking whether we know whether that was affecting puppet-syntax jobs | 17:23 |
| *** daemontool has quit IRC | 17:23 | |
| fungi | first i've heard of this one in particular, but looking | 17:23 |
| jeblair | that job failed twice on that change and it doesn't touch the file where the error was reported | 17:23 |
| mordred | fungi, jeblair: rcarrillocruz reported seeing that problem earlier today | 17:23 |
| openstackgerrit | Paul Belanger proposed openstack-infra/system-config: Default to en_US.utf8 for locale https://review.openstack.org/290709 | 17:24 |
| fungi | related issues which have come to my attention so far are jobs which sort mixed-capitalization lists and an oddness where setuptools seems to now expect setup.cfg to only contain ascii | 17:24 |
| pabelanger | testing utf8 right now ^ | 17:24 |
| clarkb | jeblair: commented, I think there is one thing | 17:24 |
| *** keedya has quit IRC | 17:25 | |
| *** ddieterly is now known as ddieterly[away] | 17:25 | |
| *** ifarkas has quit IRC | 17:25 | |
| *** sridhar_ram has quit IRC | 17:25 | |
| anteaya | mordred yolanda here is the announcement that last time we changed gerrit's ip addresses if you want to use it as a template: http://lists.openstack.org/pipermail/openstack-dev/2015-February/056508.html | 17:25 |
| *** infra-red has joined #openstack-infra | 17:26 | |
| *** nwkarsten has joined #openstack-infra | 17:26 | |
| *** jpr has joined #openstack-infra | 17:26 | |
| openstackgerrit | James E. Blair proposed openstack/gertty: Handle more than one change result when searching https://review.openstack.org/290694 | 17:27 |
| *** dtantsur is now known as dtantsur|afk | 17:27 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/system-config: Default to en_US.utf8 for locale https://review.openstack.org/290709 | 17:27 |
| clarkb | mordred: jeblair fungi rcarrillocruz's problem seemed related to not using utf8 though | 17:28 |
| *** ddieterly[away] is now known as ddieterly | 17:28 | |
| clarkb | because the error was you have non ascii data in this file | 17:28 |
| pabelanger | top search result: http://stackoverflow.com/questions/17031651/invalid-byte-sequence-in-us-ascii-argument-error-when-i-run-rake-dbseed-in-ra | 17:28 |
| fungi | clarkb: well, it's possible we're not defaulting to _any_ locale and so 7-bit/ascii-only is being assumed | 17:28 |
| clarkb | fungi: yes I think that is what is happening | 17:29 |
| jeblair | clarkb: the docs say "tags will accumulate on jobs that mach", and i think union satisfies that.... | 17:29 |
| clarkb | fungi: rather than C.utf8 | 17:29 |
| rcarrillocruz | thing is | 17:29 |
| fungi | clarkb: yeah, that's what it's starting to look like | 17:29 |
| rcarrillocruz | the test it fails doesn't run tox | 17:29 |
| clarkb | jeblair: ok, that covers the second union, but the fist is "copy" | 17:29 |
| clarkb | jeblair: I would expect copy to be a straight copy? | 17:29 |
| rcarrillocruz | so pabelanger change won't work | 17:29 |
| pabelanger | rcarrillocruz: Ah, you are right | 17:29 |
| fungi | clarkb: thinking back, debian adding the c.utf-8 compile-time default to their glibc happened after trusty was forked off | 17:29 |
| pabelanger | that's what I was just looking at | 17:30 |
| clarkb | rcarrillocruz: ya you just have to export LC_ALL=C.utf8 in the job | 17:30 |
| *** binbincong has quit IRC | 17:30 | |
| *** infra-re_ has quit IRC | 17:30 | |
| clarkb | rcarrillocruz: or in rake/bundler/rspec whtaever the thing is | 17:30 |
| rcarrillocruz | i was checking where to best put the fix | 17:30 |
| pabelanger | Right, we could add it to rake | 17:30 |
| *** dimtruck is now known as zz_dimtruck | 17:30 | |
| rcarrillocruz | cos putting it on puppet-syntax would work, although would be odd layer to put that in | 17:30 |
| *** binbincong has joined #openstack-infra | 17:30 | |
| *** zz_dimtruck is now known as dimtruck | 17:30 | |
| *** sfinucan has quit IRC | 17:30 | |
| sdague | fungi: oh yet, setup.cfg issues. I hit that on an unrelated project in travis because of LC issues | 17:31 |
| clarkb | rcarrillocruz: yes ideally it would go in the test runner process config | 17:31 |
| *** hashar has quit IRC | 17:31 | |
| sdague | amazing how many folks put smartquotes in their readme files that get dynamically pulled in | 17:31 |
| fungi | sdague: and em-dashes | 17:31 |
| sdague | yeh, I hit smartquotes and degree symbol | 17:32 |
| fungi | sdague: and unicode elipses | 17:32 |
| sdague | but, there are many | 17:32 |
| sdague | the current cookiecutters for python build a pattern that reads the readme for description | 17:32 |
| fungi | also editors are starting to auto-embed common ligatures | 17:32 |
| sdague | fungi: ... realy? | 17:32 |
| fungi | yep | 17:33 |
| clarkb | not emacs or vim | 17:33 |
| sdague | wait, ligatures are a font rendering piece | 17:33 |
| fungi | right, not _real_ editors | 17:33 |
| sdague | do you mean something else? | 17:33 |
| fungi | sdague: there are unicode codepoints for ligatures too | 17:33 |
| fungi | things like http://www.fileformat.info/info/unicode/char/fb01/index.htm | 17:34 |
| sdague | k, what thing is embedding that? | 17:34 |
| fungi | i've started seeing them show up in e-mails, for example | 17:34 |
| sdague | that's email though | 17:34 |
| fungi | not sure what clients/editors are being used to generate them | 17:34 |
| fungi | point is, there are plenty of people who are writing things in, say, ms-word and then cut-and-pasting into places | 17:35 |
| fungi | and that drags in all manner of "smart" replacements | 17:36 |
| *** esker has joined #openstack-infra | 17:36 | |
| *** tphummel has joined #openstack-infra | 17:37 | |
| pabelanger | rcarrillocruz: Ya, for now JJB will have to do. We should ask EmilienM to help migrate system-config to use bundle exec rake syntax, like the puppet team does | 17:37 |
| pabelanger | don't think it is much work to convert it | 17:37 |
| rcarrillocruz | right, cos i'm seeing the job and it doesn't use rake/bundle :/ | 17:38 |
| EmilienM | pabelanger: hey, how can I help? | 17:38 |
| clarkb | pabelanger: rcarrillocruz the other alternative is set a default locale in our instances | 17:38 |
| *** esker has quit IRC | 17:38 | |
| pabelanger | EmilienM: just bouncing the idea of moving toward how your teams validates puppet syntax using bundle / rake | 17:38 |
| jeblair | clarkb: left comments explaining the union on https://review.openstack.org/277981 | 17:38 |
| rcarrillocruz | clarkb: you mean on dib as an element or something | 17:38 |
| rcarrillocruz | ? | 17:38 |
| clarkb | rcarrillocruz: or in ubuntu-minimal | 17:39 |
| clarkb | rcarrillocruz: but yes | 17:39 |
| *** cloudtra_ has quit IRC | 17:39 | |
| rcarrillocruz | i believe that would be good... to me, this is something we should have ootb on an instance prior to running tests | 17:39 |
| anteaya | I've added an agenda item to next weeks agenda about operating system upgrades: https://wiki.openstack.org/wiki/Meetings/InfraTeamMeeting#Agenda_for_next_meeting | 17:39 |
| anteaya | the agenda has a link to an etherpad | 17:40 |
| rcarrillocruz | otoh, that will require updating images | 17:40 |
| * rcarrillocruz goes check dib elements | 17:40 | |
| clarkb | jeblair: so I guess my question is should merge and copy be distinct? you can have the behavior you describe without doing a copy that isn't really a copy | 17:40 |
| samueldmq | mordred: hi, you around ? re: os-client-config | 17:40 |
| anteaya | if there were any direct decisions that came out of yesterday's discussion about xenial and what we should do I lost track of them | 17:40 |
| clarkb | jeblair: newjob.copy(metajob), newjob.merge_tags(metajob) | 17:40 |
| mordred | jeblair, nibalizer, fungi: I can make a puppet patch to make the inventory stuff group admin - but making the openstack inventory cache stay group-admin will be harder | 17:40 |
| mordred | and will require a change to upstream ansible | 17:40 |
| anteaya | so thought it might be nice to have the discussion again | 17:40 |
| fungi | clarkb: yeah, if C.UTF-8 is available in trusty then i think we should do that rather than letting it default to ascii-only. we're installing the language packs at job runtime so probably shouldn't set a non-generic locale/lang | 17:40 |
| mordred | I can work on that of course | 17:41 |
| mordred | it'll just require a change in the logic for testing if the cached data should be used or refreshed | 17:41 |
| mordred | samueldmq: what's up? | 17:41 |
| fungi | mordred: if it's overly complicated to solve, then that's why there's sudo. i just don't like sudo being the default solution if there are easy alternatives | 17:41 |
| anteaya | AJaeger: since you have been working on job upgrades I'd really appreciate if you had a chance to update https://etherpad.openstack.org/p/infra-operating-system-upgrades with your status | 17:41 |
| *** sarob has joined #openstack-infra | 17:42 | |
| mordred | fungi: how about we sudo for now, work on the cache logic change, and when it lands remove the sudo? | 17:42 |
| EmilienM | pabelanger: for gate-system-config-puppet-syntax ? | 17:42 |
| *** degorenko is now known as _degorenko|afk | 17:42 | |
| anteaya | I did go through the meeting log and tried to extract points of concern that were raised about upgrading | 17:42 |
| fungi | clarkb: on a positive note, that's probably a very, very simple dib element (or might be suitable for the *-minimal elements?) | 17:42 |
| samueldmq | mordred: maybe in -qa ? it's related to functional tests.. I am also explaining what I mean to mtreinish now | 17:42 |
| *** cloudtrainme has joined #openstack-infra | 17:42 | |
| fungi | mordred: i'm fine with that as a stepping stone too, sure | 17:42 |
| mordred | samueldmq: I'll go there | 17:42 |
| clarkb | fungi: I think it is probably appropriate in the minimal elements | 17:42 |
| jeblair | clarkb: i think the existing way is correct because a) it is copying the attributes from the metajob to the new job; and b) it is never correct to copy some of those attributes but not others (so having two methods is not useful and could result in errors). | 17:43 |
| fungi | clarkb: also, for xenial i'm almost certain this is a solved problem (unless they decided to really buck debian's recent defaults there) | 17:43 |
| *** hdd has joined #openstack-infra | 17:43 | |
| pabelanger | EmilienM: ya | 17:43 |
| EmilienM | pabelanger: ok looking now | 17:43 |
| rcarrillocruz | EmilienM: yeah | 17:43 |
| clarkb | jeblair: you would copy the other set | 17:43 |
| clarkb | jeblair: but not union it except for where you do the explicit merge | 17:44 |
| fungi | clarkb: though the downside is that i have no idea if centos 7 or fedora 23 actually have a generic locale like that. it was at least originally a debianism to get utf8 behavior without specifying a real locale | 17:45 |
| jeblair | clarkb: i feel like we don't agree on what the copy method is doing. it is not a general purpose "make a copy of this data structure" method. it is "copy the attributes from a previous job to this one". | 17:45 |
| clarkb | fungi: it may also depend on how ubuntu-minimal deboostraps xenial? | 17:45 |
| fungi | clarkb: well, it's a compile-time default in debian's glibc | 17:45 |
| clarkb | jeblair: every other attribute appears to be a straight copy? | 17:45 |
| *** kzaitsev_mb has quit IRC | 17:45 | |
| *** notmyname has quit IRC | 17:45 | |
| jeblair | clarkb: booleans are handled specially | 17:46 |
| *** infra-re_ has joined #openstack-infra | 17:46 | |
| *** notmyname has joined #openstack-infra | 17:46 | |
| dougwig | fungi: ack, i think that's fine. i'll ping the neutron release manager just in case (mestery) | 17:47 |
| mestery | fungi dougwig: Make it so | 17:47 |
| fungi | aye aye | 17:48 |
| *** infra-red has quit IRC | 17:48 | |
| *** nwkarsten has quit IRC | 17:49 | |
| fungi | pabelanger: ianw: as our resident centos 7 and fedora 23 experts, should we expect to be able to leverage the generic C.UTF-8 locale on those platforms, or is it strictly a debianism? | 17:49 |
| *** nwkarsten has joined #openstack-infra | 17:49 | |
| zaro | morning | 17:50 |
| *** infra-red has joined #openstack-infra | 17:50 | |
| anteaya | morning zaro | 17:51 |
| pabelanger | fungi: looks like fedora added support to rawhide 6 months ago: https://bugzilla.redhat.com/show_bug.cgi?id=902094 | 17:51 |
| openstack | bugzilla.redhat.com bug 902094 in glibc "C.UTF-8 locale?" [High,Closed: rawhide] - Assigned to codonell | 17:51 |
| *** infra-r__ has joined #openstack-infra | 17:52 | |
| pabelanger | fungi: would have to read up on centos7 | 17:52 |
| fungi | okay, so promising, but extremely recent | 17:52 |
| fungi | so i guess that means f23 supports it? | 17:52 |
| pabelanger | Ya, I think so | 17:52 |
| pabelanger | let me confirm | 17:52 |
| mriedem | greghaynes: is this a thing you're still planning to work on? https://review.openstack.org/#/c/211859/ | 17:53 |
| openstackgerrit | Merged openstack-infra/storyboard: Add an "in_reply_to" column to comments https://review.openstack.org/288997 | 17:53 |
| *** infra-re_ has quit IRC | 17:53 | |
| *** annegentle has quit IRC | 17:53 | |
| greghaynes | mriedem: wow that had a lot of activity | 17:53 |
| mriedem | :) | 17:53 |
| greghaynes | mriedem: yea, that was on my short list before I went on leave | 17:54 |
| pabelanger | fungi: looks like fedora-22 was the first release to support it | 17:54 |
| *** infra-re_ has joined #openstack-infra | 17:54 | |
| *** annegentle has joined #openstack-infra | 17:54 | |
| pabelanger | http://pkgs.fedoraproject.org/cgit/rpms/glibc.git/log/?h=f22 | 17:54 |
| *** infra-red has quit IRC | 17:54 | |
| mriedem | greghaynes: cool, just asking since https://review.openstack.org/#/c/264726/ depends on it | 17:54 |
| *** kencjohnston has quit IRC | 17:54 | |
| greghaynes | mriedem: cool, was about to ask what it was blocking | 17:54 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/project-config: zuul: switch system-config to modern puppet-syntax jobs https://review.openstack.org/290726 | 17:55 |
| EmilienM | pabelanger, rcarrillocruz: it should work but I'll let CI confirm it. | 17:55 |
| clarkb | jeblair: so this is somewhat confusing because for everything else last match seems to win? | 17:55 |
| rcarrillocruz | excellent, thx | 17:55 |
| *** _nadya_ has quit IRC | 17:55 | |
| zigo | greghaynes: Hi greg ! | 17:55 |
| greghaynes | zigo: hello, I see you on that review too | 17:56 |
| zigo | greghaynes: Could you tell why it's kind of stuck right now? | 17:56 |
| zigo | And do you have plans to work on it? | 17:56 |
| greghaynes | mriedem: zigo Ill try and get to that this week, I havent updated it since I have been on paternity leave since it got new comments | 17:56 |
| *** annegentle has quit IRC | 17:56 | |
| *** infra-red has joined #openstack-infra | 17:57 | |
| greghaynes | and I still kind of am on leave but... yea ;) | 17:57 |
| zigo | The "Add debian-jessie image to nodepool" CR is blocked by it, meaning I can't even start doing packaging on upstream infra as we planned nearly a year ago... | 17:57 |
| clarkb | jeblair: which means that copy really is copying over and overwriting anything that may have been previously set | 17:57 |
| *** amotoki has quit IRC | 17:57 | |
| *** annegentle has joined #openstack-infra | 17:57 | |
| zigo | greghaynes: I see. | 17:57 |
| clarkb | I guess what it isn't doing is unsetting if the copy is also unset | 17:57 |
| zigo | greghaynes: It'd be super helpful for us if that was done, indeed ! | 17:57 |
| zigo | Thanks. | 17:57 |
| pabelanger | fungi: Ya, I don't believe centos7 support C.utf8 | 17:57 |
| mriedem | greghaynes: congrats | 17:58 |
| *** infra-r__ has quit IRC | 17:58 | |
| greghaynes | mriedem: ty :) | 17:58 |
| mordred | fungi: https://github.com/ansible/ansible/pull/14882 | 17:58 |
| zigo | greghaynes: Congrats, btw! :) | 17:58 |
| mriedem | greghaynes: by all means, pick up on work from several months ago when you're sleep deprived :) | 17:58 |
| greghaynes | zigo: Thanks | 17:58 |
| mriedem | what could go wrong?! | 17:58 |
| rcarrillocruz | greghaynes: congrats :-) | 17:58 |
| greghaynes | hehe, exactly! | 17:58 |
| openstackgerrit | Merged openstack-infra/zuul: Cloner: use cache if dest exists https://review.openstack.org/282710 | 17:58 |
| *** jpr has quit IRC | 17:58 | |
| *** slogan_r_ has quit IRC | 17:59 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/system-config: Retire old launch-node.py https://review.openstack.org/251063 | 17:59 |
| openstackgerrit | Monty Taylor proposed openstack-infra/system-config: Update for ansible and puppet apply https://review.openstack.org/247099 | 17:59 |
| openstackgerrit | Monty Taylor proposed openstack-infra/system-config: Make the shade cache and groups writable by admin https://review.openstack.org/290728 | 17:59 |
| *** zeih has joined #openstack-infra | 17:59 | |
| jeblair | clarkb: yes, but that's not what we want for tags | 17:59 |
| jeblair | clarkb: this is driven by the use case | 17:59 |
| clarkb | jeblair: right, so my suggestion would be to split the handling to make that clear | 17:59 |
| mordred | fungi, nibalizer, jeblair, clarkb: ^^ so, there is the change to make the right files group writable. we will still need to run launch-node as root until the above ansible PR lands | 17:59 |
| clarkb | copy continues to do its copying and you can do a "merge" on the tags | 18:00 |
| fungi | mordred: was that addressing weird issues where we've truncated the cache? | 18:00 |
| clarkb | then it is easy to tell from the code that the behavior is different | 18:00 |
| fungi | mordred: the ansible pr i mean | 18:00 |
| jeblair | clarkb: i think that would be more erroneous | 18:00 |
| mordred | fungi: well, it's addressing that launch_node currently does an unlink on the cache | 18:00 |
| mordred | but - oh, I need one more change | 18:00 |
| mordred | fungi: that depends-on that nasible change | 18:00 |
| *** infra-re_ has quit IRC | 18:00 | |
| jeblair | clarkb: the function does what it's intended to do, "copy attributes from another job to this one" in the way that each attribute should be aggregated | 18:00 |
| mordred | fungi: in order to keep file permissions, we need to just zero out the file and not unlink it | 18:00 |
| jeblair | clarkb: i feel like this is turning into a semantic argument about the word copy | 18:01 |
| pabelanger | EmilienM: rcarrillocruz: I think we are missing the Rakefile / Gemfile bits for bundle to work. | 18:01 |
| mriedem | ron | 18:01 |
| openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: Kill CI job if it doesn't get a testenv quickly https://review.openstack.org/290731 | 18:01 |
| fungi | pabelanger: so i guess the choice is between US-ASCII and something like en_US.UTF-8 as a locale default on centos 7? or are there better options? | 18:01 |
| jeblair | clarkb: copy doesn't have to mean "overwrite"; i feel like what the function does is still within its intended purpose, and its behavior, since it matches documentation, should be clear to a developer using it | 18:01 |
| *** annegentle has quit IRC | 18:02 | |
| jeblair | clarkb: it's also worth noting, this is not a general purpose function in a library. it has exactly one purpose and is called in one place. | 18:02 |
| fungi | pabelanger: or are there clean ways to "backport" the behavior from fedora? | 18:02 |
| clarkb | jeblair: ok, it was not clear to me and I read the documentation first (that file is first in the list) | 18:02 |
| EmilienM | pabelanger: ok I WIP'ed the patch and I'll look later, rcarrillocruz feel free to look too | 18:02 |
| pabelanger | fungi: we should see how devstack-centos7 defaults to today. Since we don't have centos-7 dib running atm | 18:02 |
| jeblair | clarkb: i'd be happy to add a comment in the function highlighting why it is different | 18:02 |
| fungi | pabelanger: yeah, i'll poke around in one for an example (and not in rackspace) | 18:02 |
| pabelanger | fungi: we could ask on ML, but it is glibc, so I imagine there will be some pushback | 18:02 |
| clarkb | jeblair: that would be good | 18:03 |
| pabelanger | fungi: since that is not in epel7, we'll need centos team to do it | 18:03 |
| openstackgerrit | Monty Taylor proposed openstack-infra/system-config: Zero out the inventory cache instead of removing it https://review.openstack.org/290734 | 18:03 |
| mordred | fungi: there ya go | 18:03 |
| *** shardy has quit IRC | 18:03 | |
| fungi | pabelanger: well, just meaning instead of having it as the built-in fallback default for glibc, wondering if there's a locale package we can preinstall to provide that and then set it explicitly in the global environment there | 18:04 |
| *** zeih has quit IRC | 18:04 | |
| fungi | pabelanger: obviously the debian (and more recently fedora) behavior of having it as the fallback compiled into glibc when you have no installed locales is awesome, but in theory it could be installed like any other locale too | 18:04 |
| *** Jeffrey4l has quit IRC | 18:05 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul: Add job tags https://review.openstack.org/277981 | 18:06 |
| *** derekh is now known as derekh_afk | 18:06 | |
| *** akshai has quit IRC | 18:06 | |
| jeblair | clarkb: ^ | 18:07 |
| *** sputnik13 has joined #openstack-infra | 18:07 | |
| pabelanger | fungi: Ya, I am not sure honestly. I would have to dig more. | 18:09 |
| fungi | mordred: ahh, got it. so that you don't need write access to the parent directory to unlink | 18:09 |
| fungi | mordred: context in the commit message might help | 18:09 |
| *** ihrachys has quit IRC | 18:10 | |
| mordred | fungi: no - it's not that | 18:10 |
| *** daemontool__ has joined #openstack-infra | 18:10 | |
| mordred | fungi: it's that if we unlink - ansible will re-create the file next time it runs | 18:10 |
| mordred | fungi: and if it does that, it's not going to do it with group admin | 18:10 |
| fungi | mordred: oh, considered setgid admin on the parent dir? | 18:11 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul: Add job tags https://review.openstack.org/277987 | 18:11 |
| *** sdake has quit IRC | 18:11 | |
| jeblair | (that's the zuulv3 tech-debt version of the patch) | 18:11 |
| mordred | fungi: hrm. sure. any idea how that works in puppet? | 18:11 |
| fungi | mordred: i do not, but i would be surprised if puppet lacks the ability to set the setgid bit on a directory | 18:12 |
| mordred | fungi: it's 7555 right? | 18:12 |
| mordred | gah | 18:12 |
| mordred | fungi: it's 2755 right? | 18:12 |
| fungi | yeah | 18:12 |
| mordred | fungi: well, fwiw, the ansible change has merged | 18:13 |
| mordred | :) | 18:13 |
| clarkb | puppet file perms should take 4 octets | 18:13 |
| clarkb | so 2755 *should* work | 18:13 |
| *** flepied1 has joined #openstack-infra | 18:13 | |
| *** flepied has quit IRC | 18:13 | |
| mordred | cool. I'm going to do ALL of these things | 18:13 |
| *** daemontool_ has quit IRC | 18:13 | |
| mordred | which is that I'm going to zero out the file and set it setgid | 18:13 |
| mordred | or maybe I won't | 18:13 |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config: Default puppet-syntax job to en_US.utf8 locale https://review.openstack.org/290739 | 18:13 |
| fungi | mordred: yeah, come at it from both directions. will never know what hit it | 18:14 |
| pabelanger | fungi: rcarrillocruz ^ that should be what we want | 18:14 |
| *** akshai has joined #openstack-infra | 18:14 | |
| clarkb | pabelanger: not C.utf8? | 18:14 |
| clarkb | (we should be consistent with whatever we seelect and sounds like C.utf8 is a default default?) | 18:14 |
| pabelanger | clarkb: we can, if we are fine with centos7 not having it | 18:14 |
| rcarrillocruz | so, on the JJB? | 18:14 |
| clarkb | pabelanger: wait you mean it doens't have the locale at all? | 18:14 |
| clarkb | pabelanger: or just that it isn't set by default? | 18:14 |
| rcarrillocruz | i thought we said to drive it with rake/bundler | 18:14 |
| rcarrillocruz | ? | 18:14 |
| rcarrillocruz | or is a fix for now, then we tackle it with rakefile/bundler later | 18:15 |
| fungi | clarkb: pabelanger: do be determined. i'm investigating the possibility now | 18:15 |
| openstackgerrit | Monty Taylor proposed openstack-infra/system-config: Zero out the inventory cache instead of removing it https://review.openstack.org/290734 | 18:15 |
| openstackgerrit | Monty Taylor proposed openstack-infra/system-config: Retire old launch-node.py https://review.openstack.org/251063 | 18:15 |
| openstackgerrit | Monty Taylor proposed openstack-infra/system-config: Update for ansible and puppet apply https://review.openstack.org/247099 | 18:15 |
| pabelanger | clarkb: right, fedora just recently added C.utf8, doesn't look like centos7 has it | 18:15 |
| openstackgerrit | Monty Taylor proposed openstack-infra/system-config: Make the shade cache and groups writable by admin https://review.openstack.org/290728 | 18:15 |
| pabelanger | rcarrillocruz: ya, just a quick fix will be investigate migrating the job | 18:15 |
| fungi | just because it's not the compile-time fallback in glibc there doesn't mean it's not an available locale, right? | 18:15 |
| rcarrillocruz | k, wfm | 18:15 |
| clarkb | pabelanger: LC_ALL=C.utf8 ls wrks for me on cnetos7 | 18:15 |
| clarkb | fungi: yes | 18:15 |
| clarkb | it is a valid present locale, it just isn't pciked by dfeault | 18:16 |
| *** daemontool__ has quit IRC | 18:16 | |
| clarkb | you can test this with touch A && touch a && touch B && touch b && ls vs LC_ALL=C.utf8 | 18:16 |
| pabelanger | clarkb: locale -a | grep C.utf8 returns empty for me on centos7 | 18:16 |
| pabelanger | but work on fedora-23 | 18:16 |
| bkero | s$ locale -a|grep ^C | 18:16 |
| bkero | C | 18:16 |
| craige | o/ | 18:17 |
| openstackgerrit | Monty Taylor proposed openstack-infra/system-config: Zero out the inventory cache instead of removing it https://review.openstack.org/290734 | 18:17 |
| bkero | Only C, no C.utf8 on my centos7 hosts | 18:17 |
| mordred | fungi, clarkb, jeblair: ^^ k. that does the setgid. and gets the latest ansible openstack inventory change | 18:17 |
| clarkb | pabelanger: ya doesn't show up in locale -a on this centos7 box but apperas to work | 18:17 |
| pabelanger | bkero: right | 18:17 |
| openstackgerrit | Monty Taylor proposed openstack-infra/system-config: Zero out the inventory cache instead of removing it https://review.openstack.org/290734 | 18:17 |
| bkero | clarkb: does garbage locale work as well? | 18:17 |
| pabelanger | clarkb: okay, I mean we can try and see what happens :) | 18:17 |
| mordred | oops. devel. not master | 18:17 |
| clarkb | bkero: maybe? let me do more investigating | 18:17 |
| fungi | clarkb: i think it may be using C as a fallback because it doesn't recognize C.utf8, but i'm still digging (and looking to see if there's an optional locales package we can install to support it there) | 18:17 |
| clarkb | fungi: ah | 18:18 |
| *** lucasagomes is now known as lucas-dinner | 18:18 | |
| bkero | clarkb: try 'LC_ALL=C.utf8 locale' | 18:18 |
| bkero | see if it spits a few messages to stderr | 18:19 |
| fungi | seeing if the locale-archive package provides it | 18:19 |
| clarkb | like locale: Cannot set LC_ALL to default locale: No such file or directory ? | 18:19 |
| bkero | yup | 18:19 |
| clarkb | so fungi is probably right | 18:19 |
| *** _nadya_ has joined #openstack-infra | 18:19 | |
| clarkb | it is falling back to C | 18:19 |
| bkero | and if you strace that, it's... open("/usr/lib/locale/C.utf8/LC_CTYPE", O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory) | 18:19 |
| fungi | yeah, the tell there would be if you tried to parse non-ascii characters | 18:20 |
| bkero | https://bugzilla.redhat.com/show_bug.cgi?id=902094 | 18:20 |
| openstack | bugzilla.redhat.com bug 902094 in glibc "C.UTF-8 locale?" [High,Closed: rawhide] - Assigned to codonell | 18:20 |
| fungi | or tried to run one of our failing jobs wit that set globally | 18:20 |
| fungi | bkero: right, pabelanger posted that one earlier | 18:20 |
| clarkb | heh utf8 locales are too large to be built in | 18:21 |
| *** jordanP has quit IRC | 18:21 | |
| fungi | there are some awesome specious comments in there, yeah | 18:21 |
| clarkb | 1.5MB | 18:21 |
| jeblair | mordred: what writes generated-groups? | 18:21 |
| fungi | fwiw, that argument was floated against doing it in debian a few years ago too | 18:21 |
| *** jaosorior has joined #openstack-infra | 18:21 | |
| clarkb | fungi: over 1.5MB? | 18:21 |
| fungi | yep | 18:21 |
| jeblair | mordred: and don't we want 0664 on several things in https://review.openstack.org/290728 ? see comments | 18:21 |
| *** cloudtrainme has quit IRC | 18:22 | |
| fungi | the embedded crowd are very protective of default-installed anything getting larger | 18:22 |
| bkero | I think embedded fedora is already hundreds of megs, heh | 18:22 |
| *** cody-somerville has quit IRC | 18:22 | |
| clarkb | right our ubuntu-minimal clocks in at 340MB ish compressed | 18:22 |
| AJaeger | anteaya: I'm lost on what I should add to the etherpad in the current form - do you want me to add a new paragraph? | 18:22 |
| clarkb | of course that could be something to do with dib and the elements | 18:23 |
| bkero | assuming you can find a package for it | 18:23 |
| bkero | I take it en_US.UTF-8 locale would produce unintended side-effects | 18:23 |
| pabelanger | okay, have to run to the dentist but can follow up when I get back. Feel free to take over my en_US.utf8 patch if you find a better solution | 18:23 |
| fungi | bkero: well, we don't preinstall that locale on our minimal systems either | 18:24 |
| *** sarob has quit IRC | 18:24 | |
| fungi | bkero: we do install it at job runtime for jobs using the default package set we provide | 18:24 |
| openstackgerrit | Monty Taylor proposed openstack-infra/system-config: Make the shade cache and groups writable by admin https://review.openstack.org/290728 | 18:24 |
| *** ajmiller has quit IRC | 18:24 | |
| mordred | jeblair: good catch - and /usr/local/bin/expand-groups.sh writes generated-groups | 18:24 |
| bkero | Huh | 18:24 |
| fungi | but having a working utf8 locale by default would be better for everyone than falling back to us-ascii i think | 18:24 |
| *** ajmiller has joined #openstack-infra | 18:25 | |
| bkero | Yeah, probably | 18:25 |
| jeblair | neat, i just got transifex spam | 18:25 |
| bkero | So is making C.utf8 support on Centos7 worth it over just including en_US.UTF-8? | 18:25 |
| openstackgerrit | Monty Taylor proposed openstack-infra/system-config: Zero out the inventory cache instead of removing it https://review.openstack.org/290734 | 18:26 |
| openstackgerrit | Monty Taylor proposed openstack-infra/system-config: Retire old launch-node.py https://review.openstack.org/251063 | 18:26 |
| openstackgerrit | Monty Taylor proposed openstack-infra/system-config: Update for ansible and puppet apply https://review.openstack.org/247099 | 18:26 |
| fungi | bkero: and current debian, fedora and coming ubuntu lts provide a default utf8 locale in their glibc. it's also a selectable locale on current ubuntu lts, which just leaves centos 7 as the outlier so i'm seeing if its something we can preinstall | 18:26 |
| jeblair | mordred: https://review.openstack.org/290728 lgtm | 18:26 |
| jeblair | fungi: ^ | 18:26 |
| *** keedya has joined #openstack-infra | 18:26 | |
| jeblair | mordred: trade you for https://review.openstack.org/277981 :) | 18:26 |
| *** zeih has joined #openstack-infra | 18:26 | |
| *** sridhar_ram has joined #openstack-infra | 18:27 | |
| mordred | jeblair: done | 18:27 |
| *** IlyaG has quit IRC | 18:27 | |
| *** cloudtrainme has joined #openstack-infra | 18:27 | |
| dmsimard | clarkb: so I'm fixing that swap thing | 18:28 |
| dmsimard | clarkb: Is the first block of the if just for HPCloud ? Can we remove that entirely, then ? | 18:28 |
| *** IlyaG has joined #openstack-infra | 18:28 | |
| dmsimard | clarkb: ref: https://github.com/openstack-infra/devstack-gate/blob/master/functions.sh#L316-L363 | 18:28 |
| *** yolanda has quit IRC | 18:28 | |
| dmsimard | ah, rax too. | 18:29 |
| *** e0ne has joined #openstack-infra | 18:29 | |
| jeblair | dmsimard: which "first block" are you asking about? | 18:29 |
| *** yolanda has joined #openstack-infra | 18:29 | |
| jeblair | dmsimard: the whole area you highlighted? | 18:29 |
| dmsimard | jeblair: no, the bit that is explained by the comment here https://github.com/openstack-infra/devstack-gate/blob/master/functions.sh#L321-L323 | 18:30 |
| bkero | fungi: http://cbs.centos.org/koji/fileinfo?rpmID=36688&filename=/usr/lib/locale/C.utf8 | 18:31 |
| dmsimard | I guess that would be https://github.com/openstack-infra/devstack-gate/blob/master/functions.sh#L350-L352 | 18:31 |
| bkero | Looks like you'd need a newer glibc-common than comes in centos7 | 18:31 |
| fungi | bkero: yeah, found that. it's the backport from fedora | 18:31 |
| *** zeih has quit IRC | 18:31 | |
| mordred | yolanda: https://review.openstack.org/#/q/status:open+project:openstack-infra/system-config+branch:master+topic:shade-launch-node | 18:31 |
| bkero | Are you guys using koji? It should be pretty easy to add that if you are. | 18:31 |
| fungi | bkero: but again, that's as a compiled-in default. i'm still hunting for whether there's just a straight up definition of the locale we could install | 18:31 |
| bkero | Ah | 18:32 |
| *** ildikov has joined #openstack-infra | 18:33 | |
| fungi | convincing centos to change default behavior of glibc is a tall order, but convincing them to add a random locale is less complicated so i'm hoping someone has already done that legwork and it's just hard to find | 18:34 |
| yolanda | mordred, thanks, i will review | 18:34 |
| openstackgerrit | Merged openstack-infra/zuul: Add job tags https://review.openstack.org/277981 | 18:35 |
| jeblair | dmsimard: i believe the second paragraph of the comment (321-323) applies to rackspace as well now, as rax has 40G root and 80G ephemeral on the flavor we use. | 18:35 |
| fungi | bkero: for example, fedora included it in their locale-archive well before changing the compile-time default in their glibc | 18:35 |
| bkero | Huh, ok | 18:36 |
| *** mriedem has quit IRC | 18:36 | |
| dmsimard | jeblair: ah, okay then. I'll leave it. | 18:36 |
| *** mriedem has joined #openstack-infra | 18:36 | |
| AJaeger | fungi, are we talking C.utf8? I'm missing this on most recent openSUSE as well ;( | 18:37 |
| jeblair | dmsimard: just double checked on a rax devstack node: | 18:38 |
| jeblair | /dev/xvda1 40G 3.4G 35G 10% / | 18:38 |
| fungi | AJaeger: yeah, would be great if more distros got on board with utf8 support by default | 18:38 |
| jeblair | /dev/xvde2 72G 6.1G 62G 10% /opt | 18:38 |
| * AJaeger will try to remember filing a bug report tomorrow | 18:38 | |
| clarkb | jeblair: dmsimard but I think rax ships with swap | 18:38 |
| yolanda | mordred, i see changes failing with mError: Could not parse for environment production: invalid byte sequence in US-ASCII at /home/jenkins/workspace/gate-system-config-puppet-syntax/modules/openstack_project/manifests/lists.pp | 18:38 |
| clarkb | so we dont need to make swap there? | 18:39 |
| jeblair | clarkb: i don't think their new flavors do | 18:39 |
| yolanda | that doesn't look related to your patch, there are gate problems? | 18:39 |
| mordred | yolanda: yah - known problem not related to those patches | 18:39 |
| mordred | yolanda: ha | 18:39 |
| clarkb | jeblair: ah | 18:39 |
| mordred | yolanda: yah - that's what the current channel conversation is about fixing | 18:39 |
| mordred | yolanda: see scrollback about C.utf8 - and try not to hit your head on your desk too hard | 18:39 |
| rcarrillocruz | yolanda: https://review.openstack.org/#/c/290739/ | 18:39 |
| dmsimard | jeblair: so is that enough space, then ? | 18:40 |
| *** electrofelix has quit IRC | 18:40 | |
| mordred | oh! | 18:40 |
| mordred | I didn't realize there was a fix in flight for the puppet-syntax jobs | 18:40 |
| jeblair | /dev/xvde1 partition799948425160-1 | 18:40 |
| fungi | AJaeger: ideally it gets fixed in glibc upstream, e.g. https://sourceware.org/bugzilla/show_bug.cgi?id=17318 | 18:40 |
| openstack | sourceware.org bug 17318 in locale "[RFE] Provide a C.UTF-8 locale by default" [Normal,New] - Assigned to unassigned | 18:40 |
| jeblair | clarkb: swap on a rax node running a devstack test ^ | 18:40 |
| * mordred hands rcarrillocruz a lovely bucket of worms as a thankyou | 18:40 | |
| yolanda | oh, no default langage is provided? | 18:41 |
| clarkb | jeblair: gotcha so it us flavor specific | 18:41 |
| * rcarrillocruz feeling warm and fuzzy with the gift | 18:41 | |
| rcarrillocruz | yolanda: yeah, due to new ubunty-trusty image | 18:42 |
| jeblair | dmsimard: enough space for what? | 18:42 |
| clarkb | rcarrillocruz: I think you mean s/fuzzy/crawly/ | 18:42 |
| rcarrillocruz | the fix is hackish | 18:42 |
| fungi | AJaeger: anyway, the lemming argument is that debian derivatives since jessie and fedora derivatives since f22 are already doing it | 18:42 |
| dmsimard | jeblair: trying to understand from your output if we still need to remount /opt | 18:42 |
| openstackgerrit | Merged openstack-infra/elastic-recheck: Add missing spaces to queries https://review.openstack.org/290230 | 18:42 |
| jeblair | fungi: "debian is doing it" should totally win more arguments in the distro world ;) | 18:42 |
| rcarrillocruz | EmilienM made a change to system-config to use otther type of puppet-syntax jobs, that use rake | 18:42 |
| yolanda | mordred, rcarrillocruz, instead of fixing that on each job, why not fix that on the image? | 18:42 |
| rcarrillocruz | real fix would probably have a rakefile on system-config with a dummy task that sets the locale | 18:42 |
| fungi | jeblair: unfortunately that doesn't always sway the glibc authors ;) | 18:42 |
| rcarrillocruz | so the fix is not in JJB, but per-project | 18:43 |
| *** kzaitsev_mb has joined #openstack-infra | 18:43 | |
| *** ddieterly is now known as ddieterly[away] | 18:43 | |
| jeblair | dmsimard: yes, i think so. i'm pretty sure that some jobs require just a bit more than what will fit on a 40G disk. though at this point, i'm not sure if it's actually grenade as much as some of the newer jobs. | 18:43 |
| *** dims has quit IRC | 18:44 | |
| dmsimard | jeblair: okay. | 18:44 |
| jeblair | mtreinish: brainstorm: collect final disk usage as a metric we can track by job on the dashboard | 18:44 |
| rcarrillocruz | but my ruby-tooling foo is weak... i can look at docs later when i finish some shade tests i'm on now... | 18:44 |
| *** yamamoto has quit IRC | 18:45 | |
| * AJaeger should better not tell that in his former life was a glibc author... | 18:45 | |
| *** claudiub has joined #openstack-infra | 18:45 | |
| fungi | bkero: clarkb: pabelanger: so the closest workaround i can find, if we don't drum up a real C.UTF-8 locale for centos 7, is to set LC_ALL=en_US.UTF-8 with LANG=C (or LANG=POSIX) to get basically similar behavior | 18:45 |
| *** dims has joined #openstack-infra | 18:46 | |
| bkero | Sounds sane to me | 18:46 |
| AJaeger | jeblair: when I left glibc the team was much more friendly than in the Drepper-Time | 18:46 |
| bkero | More sane than using backported glibc | 18:46 |
| fungi | though i wonder whether that prevents the crashes we're getting on non-ascii characters | 18:46 |
| armax | mriedem: second for a question? | 18:46 |
| bkero | AJaeger: that must have been a while ago | 18:46 |
| anteaya | AJaeger: thank you | 18:46 |
| mriedem | armax: yeah | 18:46 |
| bkero | fungi: if you can repro, should be able to test | 18:47 |
| fungi | bkero: we can totally reproduce, i just haven't tested it yet | 18:47 |
| fungi | still researching options | 18:47 |
| dhellmann | AJaeger, sdague, fungi, jeblair : can one of you take a look at this devstack-gate change to add support for mitaka branches, please? https://review.openstack.org/#/c/290701/ | 18:47 |
| armax | mriedem: I noticed yesterday that a bug we’re tracking had a signature in teh elastic-recheck repo but the failure in the gate was not detected | 18:48 |
| mriedem | armax: as in e-r didn't comment in the patch? | 18:48 |
| armax | mriedem: yes | 18:48 |
| armax | mriedem: I mean, it did not | 18:48 |
| mriedem | yeah, it's been a known issue for a few weeks | 18:48 |
| openstackgerrit | Merged openstack-infra/project-config: Default puppet-syntax job to en_US.utf8 locale https://review.openstack.org/290739 | 18:48 |
| anteaya | AJaeger: sorry I missed your earlier question | 18:48 |
| armax | mriedem: ah ok, it was unknown to me, but ok :) | 18:48 |
| anteaya | AJaeger: what you added is terrific, thank you | 18:48 |
| mriedem | armax: tip, | 18:48 |
| mriedem | armax: at the bottom of http://status.openstack.org/zuul/ is the logstash job queue | 18:48 |
| mriedem | armax: when that's all jagged, big ups and downs, there are issues | 18:49 |
| mriedem | clarkb: what was that elasticsearch status api request again? | 18:49 |
| AJaeger | anteaya: thanks | 18:49 |
| armax | mriedem: ah, I learned something new today, thank you | 18:49 |
| openstackgerrit | Craige McWhirter proposed openstack-infra/system-config: Initial commit of the Phabricator puppetry. https://review.openstack.org/289648 | 18:49 |
| mriedem | nvm https://www.elastic.co/guide/en/elasticsearch/reference/current/cluster-health.html | 18:50 |
| jeblair | mriedem: http://docs.openstack.org/infra/system-config/logstash.html#elasticsearch ? | 18:50 |
| armax | I don’t typically venture that far in the page, I will from now on | 18:50 |
| yolanda | mordred, i commented on https://review.openstack.org/#/c/251063/6, about hostname | 18:50 |
| *** ogelbukh has joined #openstack-infra | 18:50 | |
| mriedem | jeblair: we should maybe change the localhost in there | 18:50 |
| jeblair | mriedem: yep, both docs say the same url | 18:50 |
| mriedem | to logstash.openstack.org? | 18:50 |
| armax | mriedem: so I am assuming that rushing into dealing with uncategorized failures is not worth it? | 18:50 |
| jeblair | mriedem: good point | 18:51 |
| mriedem | since mere mortals don't have accesss to the ES nodes | 18:51 |
| clarkb | not everything is exlosed via the proxy though | 18:51 |
| mriedem | armax: they still show up on http://status.openstack.org/elastic-recheck/index.html | 18:51 |
| clarkb | so sometimes localhost is correct but the health is exposed | 18:51 |
| armax | mriedem: ah, ok, so it’s just e-r not posting on the review that’s not working? | 18:51 |
| mriedem | armax: yeah, and mtreinish has a wip for that https://review.openstack.org/#/c/287973/ | 18:52 |
| mordred | yolanda: that's easy enough to fix | 18:52 |
| armax | mriedem: gotcha, thanks | 18:52 |
| mordred | yolanda: I'm going to do it in a follow on patch so that it's easier for us to discuss, k? | 18:52 |
| clarkb | fungi: we should just set en_US.utf8 everywhere then | 18:52 |
| yolanda | mordred ok | 18:53 |
| openstackgerrit | Davanum Srinivas (dims) proposed openstack-infra/devstack-gate: Mitaka is now a valid stable branch https://review.openstack.org/290769 | 18:53 |
| clarkb | fungi: and avoid being different in other places | 18:53 |
| yolanda | clarkb, can this locale change to be added to some element on the ubuntu-trusty image? | 18:53 |
| *** annegentle has joined #openstack-infra | 18:53 | |
| clarkb | yolanda: yes I think it should be in ubuntu minimal or similar | 18:54 |
| fungi | clarkb: yeah, as much as i hate unnecessarily encoding americentrism into our ci, we have as a project adopted us english as a standard elsewhere (documentation projects, for example) | 18:54 |
| mriedem | clarkb: is 9200 the correct port for that health check if using logstash.o.o? | 18:54 |
| clarkb | eg a base element we add in, not one of our elements | 18:54 |
| yolanda | clarkb that solution sounds better to me than fixing jobs | 18:54 |
| clarkb | mriedem: no port 80 | 18:54 |
| mriedem | ah ok | 18:54 |
| AJaeger | pabelanger: I'm landing 289848 now, thanks! | 18:54 |
| clarkb | yolanda: well jobs that depends on specific locale should probably declare that too | 18:54 |
| fungi | clarkb: though i don't think ubuntu-minimal should necessarily be americentric, just because our systems are | 18:54 |
| anteaya | fungi: I support your argument | 18:55 |
| yolanda | clarkb yes, but the general rule shall be en_US.UTF8 everywhere ? do we have jobs that have an specific locale need? | 18:55 |
| mriedem | clarkb: huh, i get a 404 | 18:55 |
| clarkb | fungi: agreed, mostly I dont eant us whipping up a thing in project-config that everyone needs | 18:55 |
| mriedem | curl -XGET 'http://logstash.openstack.org:80/_cluster/health?pretty=true' | 18:55 |
| clarkb | mriedem: you need to root at /elasticsearch/ | 18:56 |
| clarkb | since that is where we proxy to elasticsearch | 18:56 |
| mriedem | ah that did it | 18:56 |
| *** sdake has joined #openstack-infra | 18:57 | |
| clarkb | fungi: that said I think ubuntus cloud images are americentric | 18:57 |
| openstackgerrit | Ivan Kolodyazhny proposed openstack-infra/project-config: Add non-voting job for Cinder Functional tests https://review.openstack.org/287115 | 18:57 |
| AJaeger | If any project-config core could help empty the ubuntu-trusty queue, please, it would be thankfull: https://review.openstack.org/#/q/status:open topic:bindep - all have already one +2, thanks to pabelanger and yolanda! | 18:57 |
| dims | fungi : this features.yaml update from dhellmann looks ready has clarkb's +2 as well, please peek when you get a chance - https://review.openstack.org/#/c/290701/ | 18:57 |
| fungi | trying to hold an ubuntu-trusty node before it starts running a job so i can check whether we have C.UTF-8 there without installing the language packs | 18:58 |
| fungi | but they pick up jobs far too quickly for me to be able to do that | 18:58 |
| AJaeger | fungi, do you want to enlarge our pool: https://review.openstack.org/290383 ? | 18:59 |
| anteaya | AJaeger: in your url the + gets lost somehow | 18:59 |
| yolanda | mordred, i reviewed patches, not approved due to the jenkins failures | 18:59 |
| openstackgerrit | Merged openstack-infra/project-config: Convert tox jobs with DB to use ubuntu-trusty https://review.openstack.org/289848 | 18:59 |
| openstackgerrit | David Moreau Simard proposed openstack-infra/devstack-gate: Use dd to create swapfile, ensure swap amount == 8GB https://review.openstack.org/290776 | 19:00 |
| AJaeger | anteaya: you're right - interesting tricks that chromium plays on me ;( | 19:00 |
| dmsimard | clarkb: a first attempt ^ | 19:00 |
| *** flepied has joined #openstack-infra | 19:00 | |
| anteaya | AJaeger: ah | 19:01 |
| fungi | clarkb: i think i found one way we start accumulating offline slaves on jenkins masters. i just found one (8659036 on jenkins01) where the slave agent got disconnected before it grabbed a job, so it's still showing ready in nodepool | 19:01 |
| *** markvoelker has quit IRC | 19:01 | |
| fungi | https://jenkins01.openstack.org/computer/ubuntu-trusty-ovh-gra1-8659036/ | 19:01 |
| fungi | or was still showing ready until i switched it to held | 19:01 |
| clarkb | dmsimard: looks good on first read, will have to check the test results | 19:01 |
| bkero | dmsimard: thought of using a sparsefile? | 19:01 |
| fungi | had been ready for something like 30 minutes | 19:01 |
| clarkb | bkero: yes it breaks | 19:02 |
| *** HeOS has quit IRC | 19:02 | |
| clarkb | bkero: do not recommend | 19:02 |
| *** Sukhdev has quit IRC | 19:02 | |
| dmsimard | bkero: we used a sparsefile before, it wasn't awesome | 19:02 |
| bkero | Ok | 19:02 |
| clarkb | fungi: huh | 19:02 |
| esikachev | hey folks! i have a problem with my local ci. need trigger job by timer (see https://review.openstack.org/#/c/288015/7/config/zuul/layout.yaml), but job not triggered:( can you help me? | 19:02 |
| clarkb | bkero: specifically there appear to be situations wjere sparse files cause the kernel to go on vacation | 19:02 |
| *** flepied1 has quit IRC | 19:02 | |
| fungi | bkero: we did actually try it for a bit | 19:03 |
| dmsimard | clarkb: so you mean like "mysql server has gone away" ? :p | 19:03 |
| *** markvoelker has joined #openstack-infra | 19:03 | |
| bkero | clarkb: I know it prevents you from adding sparsefiles as swap if it detects it, but you can get around that by indirecting with a loopback device | 19:03 |
| dmsimard | clarkb: I always see that error message as mysql going in vacation | 19:03 |
| fungi | bkero: it works fine as long as you don't use up too much of your disk before trying to swap | 19:03 |
| bkero | Right, in failure cases | 19:03 |
| dmsimard | bkero: that's exactly what we did | 19:03 |
| clarkb | dmsimard: well what we say was kernel watchdog saying process x y and z have not done anything for 120 seconds | 19:03 |
| bkero | Then again swap contention can sometimes nerf a host as bad as filling up disk in that scenario | 19:03 |
| *** HeOS has joined #openstack-infra | 19:03 | |
| clarkb | and the host was no longer reachable | 19:03 |
| fungi | the kernel doesn't take kindly to getting allocation failures for its memory | 19:03 |
| *** kencjohnston has joined #openstack-infra | 19:04 | |
| *** asettle has joined #openstack-infra | 19:04 | |
| clarkb | I left one overnight in that state to see if it would recover and it did not | 19:04 |
| openstackgerrit | Monty Taylor proposed openstack-infra/system-config: Use set-hostnames playbook in launch-node https://review.openstack.org/290777 | 19:04 |
| mordred | yolanda: ^^ how's that? | 19:04 |
| *** pvaneck has joined #openstack-infra | 19:06 | |
| AJaeger | anteaya: if you review, could you review https://review.openstack.org/289799 as well, please? - that removes a file that is completely unused. | 19:07 |
| yolanda | looking... set_hostname doesn't set the ip as i'd like but that's another discussion | 19:07 |
| dims | jeblair : thanks! i hope we don't need more stuff to merge the first patches to the oslo stable/mitaka branches. | 19:07 |
| mtreinish | mriedem, armax: well that just an attempt to cleanup some of the e-r internal architecture (not sure it's the right way) | 19:07 |
| mtreinish | mriedem, armax: but I'm not convinced it'll actually make it more reliable on reporting | 19:07 |
| yolanda | mordred, first time i see that -etarget on a play, what does it mean? | 19:08 |
| mtreinish | I think it's just a delay in processing on the elk side that's causing the issue | 19:08 |
| mordred | yolanda: that means "pass this extra key-value as a variable into the playbook" | 19:08 |
| *** asettle has quit IRC | 19:08 | |
| mordred | yolanda: so if you look in the set_hostnames playbook, you'll see it says "hosts:{{target}}" | 19:08 |
| *** arxcruz has joined #openstack-infra | 19:08 | |
| yolanda | ah, i was thinking of an etarget parameter :) | 19:08 |
| mordred | so we need to pass in the host to work on | 19:08 |
| mordred | hehe | 19:09 |
| *** kzaitsev_mb has quit IRC | 19:09 | |
| yolanda | is like -e{key}={value} | 19:09 |
| fungi | clarkb: _so_ we can set LC_ALL=C.UTF-8 successfully on trusty. it comes with the following available locales when no language packs are installed: C, C.UTF-8, POSIX. to default to something else (like en_US.UTF-8) we'd need to install additional packages to provide more locales (which we currently do at job runtime but not by default in the images) | 19:09 |
| mordred | yolanda: yup | 19:09 |
| mordred | yolanda: I kinda think that playbook is weird and that we should put it as host: * and run it with a limit instead | 19:09 |
| mordred | but - you know - I don't care TOO much | 19:10 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Convert gerrit jobs to ubuntu-trusty https://review.openstack.org/290779 | 19:10 |
| yolanda | mordred, syntax is correct? i've always done with -e "key=value" | 19:10 |
| fungi | clarkb: so the option is between installing extra packages on not-centos to make them have an available locale in common with centos, or setting something slightly different on centos to make it work mostly similar to the available base utf8 locale on not-centos | 19:10 |
| mordred | yolanda: I can do it with a space - the not-space will work, but if space will be easier to read, I think it's fine | 19:10 |
| anteaya | AJaeger: yes | 19:10 |
| openstackgerrit | Monty Taylor proposed openstack-infra/system-config: Use set-hostnames playbook in launch-node https://review.openstack.org/290777 | 19:11 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: hacking: Use ubuntu-trusty https://review.openstack.org/290783 | 19:11 |
| yolanda | ++ | 19:11 |
| AJaeger | thanks, anteaya ! | 19:12 |
| bkero | clarkb: looks like fallocate mkswap works on xfs if you use a loopback device: http://paste.openstack.org/show/489892/ | 19:12 |
| * AJaeger puts a few more changes in the ubuntu-trusty queue ;) | 19:12 | |
| *** andreykurilin__ has quit IRC | 19:13 | |
| *** sambetts is now known as sambetts|afk | 19:13 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Change heat-templates-buildimages to use ubuntu-trusty https://review.openstack.org/290784 | 19:14 |
| *** boris-42 has quit IRC | 19:14 | |
| anteaya | AJaeger: ah are we ready for min ready on bare-trusty to move to 1 from 8? https://review.openstack.org/#/c/290383/1/nodepool/nodepool.yaml | 19:14 |
| anteaya | AJaeger: might we move from 8 down to 4? | 19:14 |
| *** kzaitsev_mb has joined #openstack-infra | 19:15 | |
| *** tqtran has joined #openstack-infra | 19:15 | |
| anteaya | I don't know how to track min ready of various node types | 19:15 |
| *** yamamoto has joined #openstack-infra | 19:15 | |
| clarkb | bkero: that might be worth investigating but not sure if loopback was source of previous problems | 19:15 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: dib-buildimage-debian-ironic: Use ubuntu-trusty https://review.openstack.org/290786 | 19:15 |
| fungi | anteaya: AJaeger: it's mostly irrelevant when we're running under some job load. it just helps us precreate a sufficient number of available workers when the system is idle so that it can start new jobs faster when they show up out of the blue | 19:15 |
| clarkb | fungi I just worry that sort order isnt important as long as we sort properly | 19:16 |
| openstackgerrit | Valeriy Ponomaryov proposed openstack-infra/project-config: Remove redundant Manila Tempest job https://review.openstack.org/290623 | 19:16 |
| clarkb | fungi: and by using different locales in testing we end up more complicated without added benefit | 19:16 |
| openstackgerrit | Merged openstack-infra/project-config: Use ubuntu-trusty for various tox tests not using database https://review.openstack.org/289785 | 19:17 |
| *** MarkAtwood has quit IRC | 19:17 | |
| fungi | clarkb: it's a valid concern. so you're advocating for moving language-pack-en from our fallback list into ubuntu-minimal? | 19:17 |
| fungi | and possibly doing similarly on fedora 23 and soon debian | 19:17 |
| *** markvoelker has quit IRC | 19:17 | |
| openstackgerrit | Merged openstack-infra/project-config: mistral, ironic-python-agent-jobs: Convert to ubuntu-trusty https://review.openstack.org/290092 | 19:18 |
| *** markvoelker has joined #openstack-infra | 19:18 | |
| openstackgerrit | Merged openstack-infra/project-config: Remove unused selenium.yaml https://review.openstack.org/289799 | 19:18 |
| *** NikitaKonovalov has quit IRC | 19:18 | |
| openstackgerrit | Sam Yaple proposed openstack-infra/shade: Add update_service() https://review.openstack.org/287504 | 19:18 |
| fungi | clarkb: and then having the ubuntu-minimal element set a default american english utf8 locale? | 19:18 |
| AJaeger | fungi, so using 1 for bare-trusty and 8 for ubuntu-trusty is fine? With less than 100 jobs for bare-trusty and 6000 using ubuntu-trusty I'm all for changing the values... | 19:18 |
| *** SergeyLukjanov has quit IRC | 19:19 | |
| *** ruhe has quit IRC | 19:19 | |
| *** alazarev has quit IRC | 19:19 | |
| openstackgerrit | Merged openstack-infra/project-config: gate-{name}-chef-rake: Convert to ubuntu-trusty https://review.openstack.org/290373 | 19:19 |
| anteaya | fungi AJaeger oh okay well if it is irrelevant, sorry for the noise | 19:19 |
| openstackgerrit | Merged openstack-infra/project-config: Convert *plugin-jobs to ubuntu-trusty https://review.openstack.org/290348 | 19:19 |
| *** nmagnezi has joined #openstack-infra | 19:19 | |
| *** doug-fis_ has joined #openstack-infra | 19:19 | |
| fungi | AJaeger: it's fine for now. how many bare-trusty nodes did we have for our min-ready before we started this transition? we probably need somewhere near that many ubuntu-trusty for min-ready at this point | 19:19 |
| AJaeger | fungi, we had 8 bare-trusty when we started | 19:20 |
| AJaeger | So, I think it's time to lower this. | 19:20 |
| *** doug-fis_ is now known as doug-fish_ | 19:20 | |
| fungi | anteaya: it's not irrelevant, just doesn't make a huge impact most of the time | 19:20 |
| openstackgerrit | Sam Yaple proposed openstack-infra/shade: Add update_service() https://review.openstack.org/287504 | 19:20 |
| *** alazarev has joined #openstack-infra | 19:20 | |
| *** NikitaKonovalov has joined #openstack-infra | 19:20 | |
| *** zeih_ has joined #openstack-infra | 19:20 | |
| AJaeger | fungi, so this just switches the values ;) | 19:20 |
| fungi | and yeah, dropping the number of bare-trusty now that we are perhaps very infrequently running jobs on it will buy us back a handful of quota (somewhere around 1% of our capacity) | 19:21 |
| *** doug-fish has quit IRC | 19:21 | |
| *** ruhe has joined #openstack-infra | 19:21 | |
| *** SergeyLukjanov has joined #openstack-infra | 19:21 | |
| anteaya | okay sorry I missed interpreted "mostly irrelevant" | 19:21 |
| *** yamamoto has quit IRC | 19:21 | |
| anteaya | I've had better days with english skills it appears | 19:21 |
| anteaya | maybe they will come back to me soon | 19:22 |
| *** gordc has quit IRC | 19:22 | |
| *** ociuhandu has quit IRC | 19:23 | |
| openstackgerrit | Colleen Murphy proposed openstack-infra/puppet-infracloud: Add functional tests https://review.openstack.org/288840 | 19:23 |
| openstackgerrit | yolanda.robla proposed openstack/diskimage-builder: Set default locale to image in ubuntu-minimal https://review.openstack.org/290789 | 19:23 |
| yolanda | mordred, clarkb, fungi, what do you think about that? | 19:24 |
| AJaeger | fungi, anteaya, pabelanger : Down to 58 bare-trusty jobs - compare to 6000+ ubuntu-trusty | 19:24 |
| mordred | AJaeger: \o/ | 19:24 |
| anteaya | AJaeger: congratulations, nice work | 19:24 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: gate-storyboard-js-integration: Use ubuntu-trusty https://review.openstack.org/290791 | 19:24 |
| AJaeger | anteaya, mordred - thanks. But not finished yet ;) But there's light at the end | 19:25 |
| *** zeih_ has quit IRC | 19:25 | |
| AJaeger | fungi, could you review 290791, please? That job uses npm-install etc. Do we want to migrate that as is - or do it differently? | 19:25 |
| fungi | yolanda: it's broken. there is no en_US.UTF-8 provided in ubuntu-minimal. only C, C.UTF-8 and POSIX | 19:25 |
| *** akrivoka has quit IRC | 19:26 | |
| fungi | yolanda: this is the reason for our protracted debate about options | 19:26 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/project-config: Add puppet-ovn to Puppet OpenStack family https://review.openstack.org/290794 | 19:26 |
| fungi | yolanda: basically across the distros we currently use in our ci, there is no one common utf8 locale available by default | 19:26 |
| yolanda | ah ok, i thought the problem was only that no default config had been set | 19:27 |
| *** baoli_ has quit IRC | 19:27 | |
| fungi | yolanda: that is the problem, yes, but the only available utf8 locale available in the ubuntu-minimal package set currently is C.UTF-8 | 19:27 |
| yolanda | fungi and can we add more with locale-gen? | 19:27 |
| fungi | yolanda: however it's not one we seem to be able to use in centos | 19:28 |
| fungi | yolanda: we can add more by installing packages | 19:28 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: gate-bashate-devstack: Use ubuntu-trusty https://review.openstack.org/290796 | 19:28 |
| yolanda | fungi, adding some package-installs dep to language-pack? | 19:29 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: bifrost: Use ubuntu-trusty https://review.openstack.org/290798 | 19:29 |
| *** sdake_ has joined #openstack-infra | 19:30 | |
| fungi | yolanda: yeah, right now we install language-pack-en in our jobs to make locales like en_US.UTF-8 available for use there | 19:30 |
| yolanda | fungi so why not move that to the image itself? | 19:30 |
| fungi | yolanda: that is one of the options we discussed, yes | 19:31 |
| fungi | yolanda: however it raises the question of whether en_US.UTF-8 makes sense for a default for all users of dib's ubuntu-minimal or just for our ci | 19:31 |
| *** jpr has joined #openstack-infra | 19:32 | |
| *** sdake has quit IRC | 19:32 | |
| yolanda | maybe some dib cores can give some more feedback about use cases? | 19:32 |
| fungi | yolanda: particularly given that ubuntu already has an available utf8 locale available by default which is not that one | 19:32 |
| openstackgerrit | Merged openstack-infra/project-config: Update min-ready for {bare,ubuntu}-trusty https://review.openstack.org/290383 | 19:32 |
| *** jed56 has quit IRC | 19:33 | |
| fungi | yolanda: and our reason for wanting to set it to en_US.UTF-8 instead of C.UTF-8 mostly boils down to "we want ubuntu to be consistent with centos" which is probably not a valid reason to most users of that element | 19:33 |
| *** EricGonczer_ has joined #openstack-infra | 19:34 | |
| yolanda | fungi, looking at elements we have for our images... we have a common nodepool-base element in all. What about setting it there? | 19:35 |
| fungi | yolanda: yeah, if we go clarkb's preferred route of supporting en_US.UTF-8 as our default locale across all our images, then it makes the most sense to put it in one of our elements and not an upstream dib one. however your 290789 change probably makes sense in ubuntu-minimal _if_ you switch it to C.UTF-8 there | 19:36 |
| *** thorst__ has joined #openstack-infra | 19:36 | |
| fungi | i'll follow up to that change with a summary too | 19:37 |
| *** sarob has joined #openstack-infra | 19:37 | |
| yolanda | i just set mine as wip because it's under discussion. I was providing an env var to customize the default locale, but it won't be as simple because it needs to add extra packages as well, and it depends on the locale you need | 19:37 |
| fungi | yolanda: yeah, true, localegen will most likely also break there except when you take the C.UTF-8 default | 19:38 |
| yolanda | so is not easy to customize for any locale because you need to preinstall the packages. So this env var doesn't make sense | 19:39 |
| *** thorst_ has quit IRC | 19:40 | |
| *** tsg has joined #openstack-infra | 19:41 | |
| *** pots has quit IRC | 19:42 | |
| fungi | right. hard-setting it to use C.UTF-8 instead of C would be good there, i think, and consistent with how xenial-minimal will work (i think mordred says it should already exist, so easy enough to test for comparison) | 19:42 |
| openstackgerrit | David Moreau Simard proposed openstack-infra/devstack-gate: Use dd to create swapfile, ensure swap amount == 8GB https://review.openstack.org/290776 | 19:43 |
| *** gnuoy_ has joined #openstack-infra | 19:43 | |
| bswartz | anyone know where the NOT_REGISTERED errors are coming from in zuul? | 19:43 |
| fungi | however it doesn't solve the problem we have of wanting some relatively consistent behavior across centos and ubuntu/fedora (i'm unconvinced that's really a problem though--we test centos with its defaults and ubuntu/fedora with their defaults, it's not as if this is the _only_ inconsistency between these platforms) | 19:43 |
| *** ddieterly[away] has quit IRC | 19:44 | |
| fungi | bswartz: would need to know which job you're seeing that for | 19:44 |
| AJaeger | bswartz: we renamed a few jobs, please wait half an hour and recheck | 19:44 |
| *** esikachev has quit IRC | 19:44 | |
| bswartz | gate-manila-tox-nodb-genconfig | 19:44 |
| *** yamahata has quit IRC | 19:44 | |
| rcarrillocruz | that's usually when the jenkins in question doesn't have that job created | 19:44 |
| AJaeger | bswartz: yep, just renamed | 19:44 |
| *** sarob has quit IRC | 19:44 | |
| *** ociuhandu has joined #openstack-infra | 19:44 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/project-config: Add puppet-ovn to Puppet OpenStack family https://review.openstack.org/290794 | 19:44 |
| bswartz | AJaeger: okay so 30 minutes and recheck? that should be long enough? | 19:44 |
| fungi | bswartz: i'm betting that configuration updated on zuul but hasn't propagated to the jenkins masters yet | 19:44 |
| *** sdague has quit IRC | 19:45 | |
| fungi | bswartz: i'll start looking for the registration of that and give you a heads up as soon as it's showing | 19:45 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Change two tox jobs to ubuntu-trusty https://review.openstack.org/290807 | 19:45 |
| bswartz | okay | 19:45 |
| AJaeger | thanks, fungi! | 19:45 |
| *** pots has joined #openstack-infra | 19:45 | |
| fungi | AJaeger: bswartz: looks like it's already there | 19:45 |
| fungi | so should be able to recheck now | 19:45 |
| openstackgerrit | Tim Buckley proposed openstack-infra/puppet-subunit2sql: Fix log_url parsing for new job types https://review.openstack.org/288234 | 19:46 |
| *** woodster_ has joined #openstack-infra | 19:47 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: WIP: Remove bare-trusty from projects.yaml https://review.openstack.org/290809 | 19:47 |
| *** cloudtrainme has quit IRC | 19:48 | |
| *** sigmavirus24 is now known as sigmavirus24_awa | 19:48 | |
| *** abregman has joined #openstack-infra | 19:49 | |
| *** gnuoy_ has quit IRC | 19:49 | |
| *** gildub has joined #openstack-infra | 19:49 | |
| *** esikachev has joined #openstack-infra | 19:50 | |
| *** salv-orlando has joined #openstack-infra | 19:51 | |
| fungi | clarkb: yolanda: pabelanger: so the more i think about this, the more i'm not convinced we need the same default locale on centos 7.x as we have on fedora 23 or ubuntu trusty. we should provide _some_ utf8 locale as a default on each of them, but as for sort order, any tests depending on sorts really ought to explicitly declare a locale. inconsistencies between different developers' systems mean it | 19:51 |
| fungi | will already vary. i doubt i'm the only developer with a local default which does not collate the same as en_US.UTF-8 | 19:51 |
| fungi | there are plenty of default differences between our test platforms, and that's one of the reasons we test on multiple platforms | 19:53 |
| *** salv-orl_ has joined #openstack-infra | 19:53 | |
| *** BigWillie has quit IRC | 19:54 | |
| *** sdague has joined #openstack-infra | 19:54 | |
| *** IlyaG has quit IRC | 19:54 | |
| *** doug-fish has joined #openstack-infra | 19:55 | |
| *** doug-fish_ has quit IRC | 19:55 | |
| *** salv-orlando has quit IRC | 19:56 | |
| *** piet has quit IRC | 19:56 | |
| *** sridhar_ram1 has joined #openstack-infra | 19:58 | |
| *** piet has joined #openstack-infra | 19:58 | |
| openstackgerrit | Ryan Hallisey proposed openstack-infra/tripleo-ci: Allow the continer job to run again https://review.openstack.org/288915 | 19:59 |
| *** piet has quit IRC | 19:59 | |
| *** sridhar_ram has quit IRC | 19:59 | |
| *** piet has joined #openstack-infra | 20:00 | |
| *** sarob has joined #openstack-infra | 20:01 | |
| *** jaosorior has quit IRC | 20:02 | |
| *** gordc has joined #openstack-infra | 20:02 | |
| *** jaosorior has joined #openstack-infra | 20:03 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Remove wrong node declaration from javascript https://review.openstack.org/290821 | 20:04 |
| AJaeger | project-config cores, could you review this one, please? That's an error I introduced ^ | 20:04 |
| fungi | mordred: see my question on 284352. i wouldn't normally -1 for a question but in this case it would make sense to clean that up if it really is just a benign stray \ and not meant as a line continuation | 20:04 |
| fungi | mordred: my concern is that you meant to add another line after that and it got lost in the shuffle | 20:05 |
| *** Sukhdev has joined #openstack-infra | 20:05 | |
| *** sarob has quit IRC | 20:05 | |
| prometheanfire | what do I need to do to add a nightly or weekly job to diskimage-builder? | 20:06 |
| fungi | prometheanfire: there's a "periodic" pipeline you would need to add to your project in the zuul/layout.yaml in project-config | 20:06 |
| AJaeger | thanks, jeblair and fungi for fast review | 20:07 |
| fungi | prometheanfire: also be aware that a periodic job trigger does not convey all the same parameters as pipelines like check or gate (because there is no associated change, no commit, no branch) so you need to make sure you're explicit about those things in your job instead | 20:07 |
| jeblair | fungi, mordred: i also just realized we sholud conisder https://review.openstack.org/284352 along with https://review.openstack.org/284346 | 20:07 |
| fungi | hah, indeed | 20:08 |
| AJaeger | a question to the experts: Should we remove - as I did for testing in https://review.openstack.org/#/c/290809/ - the "node: bare-trusty" lines from projects.yaml? Or change them all to ubuntu-trusty? | 20:08 |
| * AJaeger is currently searching for missing pieces... | 20:08 | |
| *** gyee has quit IRC | 20:08 | |
| fungi | AJaeger: i think if you remove the node: bare-trusty lines that should prompt the jjb check to let you know if it was still being used in any templates | 20:09 |
| prometheanfire | fungi: hopefully there will be a template I can follow | 20:09 |
| AJaeger | fungi, yes - that'S how I found that bug ;) | 20:09 |
| EmilienM | is it expexted that irc-access job fails ? http://logs.openstack.org/94/290794/2/check/gate-project-config-irc-access/b5f7921/console.html#_2016-03-09_19_49_55_890 | 20:09 |
| AJaeger | fungi, I want to konw whether I should unWIP it in the end - or rename | 20:10 |
| clarkb | fungi I can go with that argument | 20:10 |
| fungi | AJaeger: my takeaway from yesterday's discussion is that we wanted to stop templating default node: values from project definitions, so remove them | 20:10 |
| anteaya | EmilienM: I think the point of the job is for it to pass | 20:10 |
| AJaeger | fungi, thanks for confirming | 20:10 |
| anteaya | EmilienM: but to fail if a channel listed doesn't have infra permissions | 20:11 |
| EmilienM | anteaya: this is my change: https://review.openstack.org/#/c/290794/ | 20:11 |
| yolanda | fungi i think setting utf8 locale in all systems, not caring about the language, will be enough. But for consistency, we may want to set a common one in all of our images by reusing some infra element. Do you know if it's simple or we may find some problems in some of the distros, installing en_US.UTF-8? | 20:11 |
| EmilienM | I do nothing special with channels | 20:11 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Change gitdm jobs to use ubuntu-trusty https://review.openstack.org/290825 | 20:11 |
| fungi | yolanda: i think that deviating from the default locales provided in our platforms means we're less likely to be doing representative testing on those platforms. consistency across platforms for the sake of consistency seems like a slippery slope | 20:12 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: gerrit-plugin-jobs: Use ubuntu-trusty https://review.openstack.org/290826 | 20:13 |
| *** arxcruz has quit IRC | 20:13 | |
| *** daemontool has joined #openstack-infra | 20:14 | |
| anteaya | EmilienM: puppet-ovn is listed twice | 20:14 |
| anteaya | EmilienM: according to the log | 20:14 |
| fungi | yolanda: and jobs which depend on a consistent locale probably should go the extra step to ensure it's available and set. we can't easily ensure our platforms' locales will be consistent with any random developer's locale settings, for example, nor should we expect to | 20:14 |
| anteaya | EmilienM: but it isn't in the patch | 20:14 |
| *** jcoufal has joined #openstack-infra | 20:15 | |
| *** |-paul-| has joined #openstack-infra | 20:15 | |
| yolanda | fungi that's a good point. But then we are hitting the same argument for forcing utf8 in an image. If default image is not bringing it, and we force it on the base images, we are masking that issue somehow | 20:15 |
| anteaya | AJaeger: do you have a moment to look at why check-channels.yaml believes that puppet-ovn is listed twice? http://logs.openstack.org/94/290794/2/check/gate-project-config-irc-access/b5f7921/console.html#_2016-03-09_19_49_55_888 | 20:15 |
| AJaeger | anteaya: will check in a minute... | 20:16 |
| EmilienM | anteaya: yeah, this job is new iiuc, maybe a bug | 20:16 |
| anteaya | AJaeger: sorry sorry no bother | 20:16 |
| anteaya | EmilienM: I see it | 20:16 |
| AJaeger | ;) | 20:16 |
| anteaya | the log is saying that you have it above oslo and alphabetically it should be below | 20:16 |
| anteaya | see the - and the + signs in the log? | 20:17 |
| prometheanfire | fungi: looks like I'll need to define a new check, like gate-dib-dsvm-functests-devstack-trusty | 20:17 |
| prometheanfire | don't see that in project config though | 20:17 |
| openstackgerrit | Fei Long Wang proposed openstack-infra/project-config: Remove pypy's gate for zaqarclient https://review.openstack.org/290827 | 20:17 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/project-config: Add puppet-ovn to Puppet OpenStack family https://review.openstack.org/290794 | 20:17 |
| EmilienM | anteaya: cool thx | 20:17 |
| anteaya | welcome | 20:17 |
| fungi | yolanda: yes, i agree. it's not black-and-white. the argument for adding it is that newer releases of those distros are already going that direction. my suggestion is around backporting their respective base default behaviors (without actually backporting their newer glibc versions of course) | 20:18 |
| *** Slower has joined #openstack-infra | 20:18 | |
| openstackgerrit | Eric Brown proposed openstack-infra/project-config: Update gate-bandit-integrations projects https://review.openstack.org/282850 | 20:19 |
| Slower | A friend of mine is trying to sign the new contributor agreement at https://review.openstack.org/#/settings/new-agreement | 20:19 |
| Slower | and we get a server error: Server error: Cannot store contact information | 20:19 |
| gordc | AJaeger: with this change: https://review.openstack.org/#/c/289848/, does this mean i need to update my tox envlist to include 'db-' prefix? | 20:19 |
| Slower | not sure if you guys deal with that or not? | 20:19 |
| fungi | Slower: make sure they followed _all_ the steps in http://docs.openstack.org/infra/manual/developers.html#account-setup | 20:20 |
| Slower | fungi: ok | 20:20 |
| AJaeger | gordc: no, not at all. | 20:20 |
| fungi | Slower: and if they were following some other instructions somewhere, please let us know where to find those so we can get them removed/redirected to the correct procedure | 20:20 |
| AJaeger | just the job name changed, we still invoke the same target | 20:20 |
| AJaeger | gordc: envlist stays the same | 20:20 |
| *** acabot has quit IRC | 20:20 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: gate-{name}-npm-run-{command}: Use ubuntu-trusty https://review.openstack.org/290828 | 20:21 |
| *** sdake has joined #openstack-infra | 20:21 | |
| gordc | AJaeger: for some reason, those jobs show up as not registered now :https://review.openstack.org/#/c/290626/ | 20:21 |
| *** kencjohnston has quit IRC | 20:21 | |
| AJaeger | gordc: let me check - this normally happens if Zuul was updated faster than jenkins... | 20:22 |
| Slower | fungi: cool thx! | 20:22 |
| gordc | AJaeger: kk, no problem. it might also be some quirky thing we're doing as well | 20:22 |
| fungi | Slower: you bet, and let us know if that still doesn't resolve the issue | 20:23 |
| prometheanfire | where are the checks defined? would likely base the checks off of gate-dib-dsvm-functests-devstack-trusty | 20:23 |
| gordc | thanks for looking | 20:23 |
| AJaeger | gordc: job is registered now, I run recheck | 20:23 |
| *** sdake_ has quit IRC | 20:23 | |
| prometheanfire | I see it refrence the check, but don't know where that is sourced from | 20:23 |
| prometheanfire | I'll need to add another one | 20:23 |
| prometheanfire | gate-dib-dsvm-functests-devstack-gentoo or something | 20:23 |
| openstackgerrit | Monty Taylor proposed openstack-infra/system-config: Add a playbook and script for doing adhoc puppet https://review.openstack.org/284352 | 20:24 |
| openstackgerrit | Monty Taylor proposed openstack-infra/system-config: Use set-hostnames playbook in launch-node https://review.openstack.org/290777 | 20:24 |
| bknudson | anybody know of a decent python library for gerrit rest API? | 20:24 |
| openstackgerrit | Monty Taylor proposed openstack-infra/system-config: Zero out the inventory cache instead of removing it https://review.openstack.org/290734 | 20:24 |
| openstackgerrit | Monty Taylor proposed openstack-infra/system-config: Retire old launch-node.py https://review.openstack.org/251063 | 20:24 |
| openstackgerrit | Monty Taylor proposed openstack-infra/system-config: Update for ansible and puppet apply https://review.openstack.org/247099 | 20:24 |
| openstackgerrit | Monty Taylor proposed openstack-infra/system-config: Fix manual puppet run command docs https://review.openstack.org/284346 | 20:24 |
| openstackgerrit | Monty Taylor proposed openstack-infra/system-config: Make the shade cache and groups writable by admin https://review.openstack.org/290728 | 20:24 |
| fungi | prometheanfire: commonly, projects instantiate new jobs from a job template and provide a pipeline prefix of "periodic" for them. for examples see http://git.openstack.org/cgit/openstack-infra/project-config/tree/jenkins/jobs/python-bitrot-jobs.yaml | 20:24 |
| mordred | jeblair, fungi ^^ | 20:24 |
| openstackgerrit | Merged openstack-infra/project-config: Remove wrong node declaration from javascript https://review.openstack.org/290821 | 20:24 |
| AJaeger | gordc: there's a short window when new jobs get created or renamed where zuul knows about them but no jenkins yet - recheck is the solution | 20:24 |
| gordc | AJaeger: cool cool. i'll do that | 20:24 |
| fungi | bknudson: i think pygerrit is popular recently | 20:24 |
| gordc | thanks again | 20:24 |
| AJaeger | gordc: you're welcome. Sorry for the interruption of service | 20:24 |
| fungi | bknudson: https://pypi.python.org/pypi/pygerrit | 20:24 |
| bknudson | fungi: thanks, pygerrit looks pretty good and complete | 20:25 |
| *** ihrachys has joined #openstack-infra | 20:25 | |
| fungi | bknudson: that said, it's also not hard to just roll your own. the trickiest parts are doing the digest auth in requests and knowing what to set/look for to paginate some responses | 20:26 |
| openstackgerrit | Eric Brown proposed openstack-infra/project-config: Update gate-bandit-integrations projects https://review.openstack.org/282850 | 20:26 |
| fungi | bknudson: aside from that, the rest api they have is extremely straightforward and thoroughly documented | 20:26 |
| bknudson | fungi: y, I just used requests but I looked for a library first and the couple I looked at looked incomplete. Even http://pythonhosted.org/pygerrit/pygerrit.rest.html#id1 doesn't have a list reviews. | 20:27 |
| fungi | bknudson: i have an example at https://review.openstack.org/263971 though gertty is also a prime example of rest api use | 20:28 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: gate-anvil-venv-{node}: Use ubuntu-trusty https://review.openstack.org/290831 | 20:29 |
| jeblair | bknudson: what would "list reviews" return? | 20:29 |
| fungi | bknudson: you're looking for the "changes" method i assume | 20:29 |
| *** Sukhdev has quit IRC | 20:29 | |
| jeblair | ah yeah, it's probably worth using the gerrit terminology | 20:29 |
| bknudson | y, https://review.openstack.org/Documentation/rest-api-changes.html#list-changes | 20:29 |
| AJaeger | change 290831 is the last patch in conversion to ubuntu-trusty if I didn't miss any... | 20:30 |
| openstackgerrit | Matt Riedemann proposed openstack-infra/elastic-recheck: Add a cluster health indicator to the graph output https://review.openstack.org/290832 | 20:30 |
| bknudson | I also needed o=CURRENT_REVISION | 20:30 |
| bknudson | so it would be nice to have some of the change query coded | 20:30 |
| jeblair | bknudson: what's the project you're working on? | 20:30 |
| AJaeger | project-config cores: I hope I'm done with ubuntu-trusty conversion. The changes in the queue are some of the more odd jobs, please review carefully: https://review.openstack.org/#/q/topic:bindep+status:open | 20:31 |
| bknudson | jeblair: I wrote a script to lift my -2s off of all the reviews in a project (e.g., oslo.config) | 20:31 |
| bknudson | I -2d all the changes that were proposing new features until we created stable branches | 20:31 |
| jd__ | sorry if I'm late but what's those new NOT_REGISTERED on our reviews for Gnocchi e.g. https://review.openstack.org/#/c/270322/ ? | 20:32 |
| bknudson | I haven't posted the code anywhere... I should get it on github or something | 20:32 |
| jeblair | bknudson: (yeah, some data are more expensive, and so you have to add extra flags to tell gerrit to do the work to add them in; i'm not sure how you could automatically do that in a lib except to also say things like "current_revision=True"...) | 20:32 |
| yolanda | fungi i'll amend that change to set c.utf-8 and get it ready for review then | 20:32 |
| AJaeger | jd__: see my converstaion with gordc above | 20:32 |
| AJaeger | jd__: please recheck - and if it still fails, tell us again. This should be fixed now | 20:33 |
| jeblair | bknudson: cool... and it might be a bit late for this, but, fyi, gertty has a batch-review feature, so you can do a query for all of your -2 changes in a project, and then lift them all that way. | 20:33 |
| *** kencjohnston has joined #openstack-infra | 20:33 | |
| bknudson | jeblair: I really should have looked at gertty first. I was thinking about it the whole time. (I used the .gertty.yaml for the username/password) | 20:33 |
| jeblair | bknudson: heh, yeah i have some adhoc tools that read that file too :) | 20:34 |
| jeblair | bknudson: we'll say it's my fault since i haven't really written good documentation on batch reviewing yet | 20:34 |
| openstackgerrit | Merged openstack-infra/devstack-gate: add mitaka and ocata branches to feature list https://review.openstack.org/290701 | 20:34 |
| fungi | yolanda: thanks! | 20:34 |
| jd__ | AJaeger: ok thanks, sorry for the disturbance :) | 20:34 |
| AJaeger | jd__: sorry for the disruption of service | 20:35 |
| openstackgerrit | yolanda.robla proposed openstack/diskimage-builder: Set default locale to image in ubuntu-minimal https://review.openstack.org/290789 | 20:35 |
| jd__ | shit happens :) | 20:35 |
| bknudson | Batch review sounds dangerous. Submitters think I batch -1 already. | 20:35 |
| AJaeger | jd__: not shit - just a "race" in how we update zuul and jenkins | 20:35 |
| fungi | bknudson: it's awesome actually | 20:35 |
| yolanda | ok fixed | 20:36 |
| openstackgerrit | Matt Riedemann proposed openstack-infra/elastic-recheck: Add a cluster health indicator to the graph output https://review.openstack.org/290832 | 20:36 |
| jd__ | hehe | 20:36 |
| fungi | bknudson: though i started trying to code up a batch abandon and got lost in gertty's internal structure because i don't spend enough time there | 20:36 |
| mriedem | clarkb: armax: https://review.openstack.org/#/c/290832/ | 20:36 |
| bknudson | fungi: batch abandon in gertty? | 20:38 |
| bknudson | oh, you mentioned gertty. I thought you said "gerrit" | 20:39 |
| fungi | bknudson: yeah, i have some 40 test changes in a topic which it's time for me to abandon. i was able to batch-wip them in gertty, but batch-abandon will require implementation | 20:39 |
| bknudson | wip marking is one of the more annoying things in our gerrit | 20:40 |
| *** cloudtrainme has joined #openstack-infra | 20:41 | |
| *** esikachev has quit IRC | 20:42 | |
| openstackgerrit | Merged openstack-infra/system-config: Reinstall requests on Fedora builds https://review.openstack.org/285876 | 20:42 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: beaker-jobs: Convert to ubuntu-trusty https://review.openstack.org/290838 | 20:43 |
| AJaeger | Missed at least one ^ | 20:43 |
| *** salv-orl_ has quit IRC | 20:43 | |
| jlvillal | https://review.openstack.org/#/c/271463/ Hasn't had a review for six weeks :( Really trivial patch to fix error seen. | 20:44 |
| prometheanfire | so, dib has run_functests.sh which as a run_ramdisk_element_test function, but I can't find what runs that function | 20:44 |
| openstackgerrit | Matt Riedemann proposed openstack-infra/elastic-recheck: Pretty print json output when writing to a file https://review.openstack.org/290840 | 20:44 |
| prometheanfire | how many layers do i have to go? | 20:44 |
| prometheanfire | that function isn't refrenced in dib or project-config | 20:45 |
| *** burgerk has joined #openstack-infra | 20:45 | |
| *** asettle has joined #openstack-infra | 20:46 | |
| openstackgerrit | Merged openstack-infra/system-config: Fix manual puppet run command docs https://review.openstack.org/284346 | 20:46 |
| *** hashar has joined #openstack-infra | 20:46 | |
| clarkb | prometheanfire: with bash testing I think its common to make an array of functions and cal them all sort of deal | 20:47 |
| clarkb | prometheanfire: so its presence may cause it to implicitly run | 20:47 |
| prometheanfire | I can't find ie anywhere :| | 20:47 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: gate-anvil-venv-{node}: Use ubuntu-trusty https://review.openstack.org/290831 | 20:47 |
| clarkb | mriedem: +2 | 20:48 |
| fungi | prometheanfire: tried a git grep in the diskimage-builder repo? | 20:48 |
| pabelanger | AJaeger: okay, think I got them all :) | 20:48 |
| prometheanfire | tried a straight grep | 20:48 |
| fungi | prometheanfire: also, the last resort of the desperate is http://codesearch.openstack.org/ | 20:48 |
| prometheanfire | it's refrenced in its instansiation and a comment only | 20:49 |
| *** doug-fish has quit IRC | 20:49 | |
| prometheanfire | and that only returns those two lines as well | 20:49 |
| prometheanfire | http://codesearch.openstack.org/?q=run_ramdisk_element_test&i=nope&files=&repos= | 20:49 |
| openstackgerrit | Sam Yaple proposed openstack-infra/shade: Test v3 params on v2.0 endpoint; Add v3 unit https://review.openstack.org/289083 | 20:49 |
| openstackgerrit | Sam Yaple proposed openstack-infra/shade: Update create_endpoint() https://review.openstack.org/289051 | 20:49 |
| fungi | prometheanfire: then as clarkb surmises, it's likely that its very existence causes it to be run | 20:49 |
| prometheanfire | ya | 20:50 |
| prometheanfire | now I need to figure out that | 20:50 |
| prometheanfire | so many layers | 20:50 |
| clarkb | prometheanfire: I found it | 20:50 |
| clarkb | one sec | 20:50 |
| fungi | prometheanfire: worst case, talk to some of the dib maintainers (they hang out in #tripelo) | 20:50 |
| clarkb | https://git.openstack.org/cgit/openstack/diskimage-builder/tree/tests/run_functests.sh#n176 | 20:50 |
| clarkb | there | 20:50 |
| *** asettle has quit IRC | 20:50 | |
| fungi | prometheanfire: sometimes i'll go so far as to git blame the file and then harass whoever it identifies added the code ;) | 20:51 |
| *** ihrachys has quit IRC | 20:51 | |
| prometheanfire | clarkb: found it at about the same time as you I think | 20:51 |
| *** IlyaG has joined #openstack-infra | 20:52 | |
| pabelanger | DDDSo, I'm noticing some slowness on vexxhost: https://jenkins02.openstack.org/job/gate-system-config-puppet-syntax/390/console | 20:53 |
| clarkb | I am working on flushing out topic:bindep now | 20:53 |
| pabelanger | s/DDD//g | 20:53 |
| pabelanger | up to 30mins for puppet-syntax job | 20:53 |
| dmsimard | ianw: checking that the swapfile is in /proc/swaps sounds like a good sanity check | 20:53 |
| prometheanfire | looks like I'll need to copy fedora's way of doing it maybe | 20:53 |
| pabelanger | seems to be some IO issues | 20:53 |
| dmsimard | ianw: the size is always going to be slightly off and not exactly 8192MB | 20:53 |
| AJaeger | pabelanger: thanks for reviewing! 290831 contained a typo that I just fixed | 20:53 |
| *** armax has quit IRC | 20:53 | |
| *** e0ne has quit IRC | 20:53 | |
| *** annegentle has quit IRC | 20:54 | |
| dmsimard | ianw: i.e, a 8192MB swapfile reports as 8388604 kilobytes (or kibibytes?) which is ~8191.99MB | 20:54 |
| *** armax has joined #openstack-infra | 20:54 | |
| *** tqtran has quit IRC | 20:54 | |
| *** tqtran has joined #openstack-infra | 20:55 | |
| pabelanger | AJaeger: Ah, see it now | 20:55 |
| ianw | dmsimard: well, 2047 pages i think that is | 20:55 |
| dmsimard | also, what happens if the swapfile isn't mounted as expected ? we exit 1 ? | 20:55 |
| ianw | dmsimard: but yeah, even just a arithmetic > check for close to that will be fine | 20:56 |
| fungi | pabelanger: is it consistently slow across jobs, or just that one time? | 20:56 |
| AJaeger | EmilienM: you can change the depends-on on your new proejcts - first merge project-config, then governance | 20:56 |
| openstackgerrit | Mark Vanderwiel proposed openstack-infra/project-config: Increase heat timeout with addition of new lbaasv2 scenario tests https://review.openstack.org/287836 | 20:56 |
| EmilienM | AJaeger: so we import something in project-config that is not validated by TC? | 20:56 |
| pabelanger | fungi: Ya, currently this job on vexxhost. | 20:56 |
| ianw | dmsimard: yep, just exit 1 ... at least we'll know about it quickly then. we actually had similar issues before when hpcloud stopped providing an ephemeral drive iirc | 20:56 |
| dmsimard | ianw: ok. | 20:56 |
| pabelanger | fungi: pushing 30mins, when it usually takes 3 mins | 20:57 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/project-config: Add puppet-ovn to Puppet OpenStack family https://review.openstack.org/290794 | 20:57 |
| pabelanger | fungi: and just looks to be doing apt-get install ATM | 20:57 |
| AJaeger | EmilienM: yes, we do - let me give you a link... | 20:57 |
| prometheanfire | it looks like I can just add the test-elemets dir and it will get picked up automatically | 20:57 |
| AJaeger | EmilienM: http://docs.openstack.org/infra/manual/creators.html#add-new-repository-to-the-governance-repository | 20:57 |
| EmilienM | AJaeger: ok cool | 20:58 |
| AJaeger | EmilienM: our approach - as blessed by TC - is that a PTL needs to +1 the import, provide the governance change as well - and we merge. But read the section for details. | 20:58 |
| *** sigmavirus24_awa is now known as sigmavirus24 | 20:58 | |
| AJaeger | The TC will not vote on it, it's just housekeeping to merge it once it has PTL approval | 20:58 |
| EmilienM | it makes sense | 20:59 |
| clarkb | AJaeger: any idea what the congress new_arch tox job does? | 20:59 |
| clarkb | AJaeger: https://review.openstack.org/#/c/290807/1/jenkins/jobs/projects.yaml | 20:59 |
| openstackgerrit | David Moreau Simard proposed openstack-infra/devstack-gate: Use dd to create swapfile, ensure swap amount == 8GB https://review.openstack.org/290776 | 20:59 |
| AJaeger | clarkb: it runs congress/tests2 tests | 20:59 |
| openstackgerrit | Sam Yaple proposed openstack-infra/shade: Add update_service() https://review.openstack.org/287504 | 20:59 |
| clarkb | AJaeger: and they don't need the db? | 20:59 |
| AJaeger | clarkb: they use testr, I don't think they need it. | 20:59 |
| clarkb | AJaeger: it depends on if the tests themselves need a database | 21:00 |
| fungi | pabelanger: worth noting, apt/dpkg is very hard on the filesystem because it syncs after just about every write to avoid inconsistencies in the event of an unexpected reboot/crash | 21:00 |
| fungi | pabelanger: there are probably things we should consider doing to make that much, much faster on our test nodes | 21:00 |
| AJaeger | clarkb: my quick grep was not conclusive - shall we try and fix or be on the safe? | 21:00 |
| * AJaeger updates 290807 | 21:01 | |
| fungi | pabelanger: because we don't care if a reboot or crash puts their package registry in an inconsistent state, since we're just going to blow them away a few minutes or even seconds later | 21:01 |
| clarkb | AJaeger: it might be good to be safe | 21:01 |
| clarkb | AJaeger: then they can remove the db later if it isn't needed | 21:01 |
| fungi | AJaeger: as an example, nova's unit tests run under testr but still expect to have databases | 21:01 |
| AJaeger | ah, ok | 21:02 |
| AJaeger | fixed, thanks for reviewing and asking, clarkb | 21:02 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Change two tox jobs to ubuntu-trusty https://review.openstack.org/290807 | 21:02 |
| fungi | AJaeger: worse, if we run them without databases they'll still pass, but quietly skip the database tests. and then soon after that someone will break mysql support in a nova patch and it will merge | 21:02 |
| *** sarob has joined #openstack-infra | 21:02 | |
| openstackgerrit | Merged openstack-infra/project-config: Change gitdm jobs to use ubuntu-trusty https://review.openstack.org/290825 | 21:02 |
| *** thiagop has quit IRC | 21:02 | |
| AJaeger | fungi, yeah - that one item is still open to figure out | 21:02 |
| fungi | AJaeger: which is why i'm still mentally composing my ml plea for adding a means of forcing database tests to always run | 21:03 |
| openstackgerrit | James E. Blair proposed openstack/gertty: Support batch abandon/restore https://review.openstack.org/290852 | 21:03 |
| openstackgerrit | David Moreau Simard proposed openstack-infra/devstack-gate: Use dd to create swapfile, ensure swap amount == 8GB https://review.openstack.org/290776 | 21:03 |
| jeblair | fungi, bknudson: https://review.openstack.org/290852 | 21:03 |
| fungi | jeblair: and to think i spent close to an hour trying to figure out how to do that last weekend before getting unbelievably lost and going out for beer instead | 21:04 |
| pabelanger | fungi: Sure, what are you suggesting? Changes to apt/dpkg configuration? | 21:04 |
| openstackgerrit | David Moreau Simard proposed openstack-infra/devstack-gate: Use dd to create swapfile, ensure swap amount == 8GB https://review.openstack.org/290776 | 21:04 |
| fungi | pabelanger: changes to prevent it from syncing the fs | 21:04 |
| jeblair | fungi: i guess i know which things to copy pasta? :) | 21:04 |
| fungi | pabelanger: like running apt-get install under eatmydata or something | 21:04 |
| openstackgerrit | Merged openstack-infra/project-config: gate-{name}-npm-run-{command}: Use ubuntu-trusty https://review.openstack.org/290828 | 21:04 |
| fungi | jeblair: yep, that's what i was trying to do too. on the other hand, makes it easier to review your change now! | 21:05 |
| *** dims has quit IRC | 21:05 | |
| pabelanger | fungi: interesting, never seem that package before | 21:05 |
| jeblair | fungi: time well spent then. also the time with the beer. | 21:05 |
| fungi | jeblair: since i spent a lot of time staring at the adjacent functions | 21:05 |
| fungi | i feel vindicated that at least some of this looks like what i had. now hopefully it doesn't crash like mine did ;) | 21:06 |
| AJaeger | pabelanger: do you want to review 290807 again, please? | 21:06 |
| sobersabre | ok, fdegir I'm off, too late. pls do review 287497, it's very simple and is also keeping jjb in sync. | 21:07 |
| openstackgerrit | Brant Knudson proposed openstack-infra/release-tools: Add update_reviews tool https://review.openstack.org/290853 | 21:07 |
| pabelanger | AJaeger: done | 21:08 |
| sobersabre | fdegir: Thanks, man. | 21:08 |
| *** sobersabre has quit IRC | 21:08 | |
| AJaeger | thanks, pabelanger | 21:08 |
| *** sarob has quit IRC | 21:09 | |
| AJaeger | 20 bare-trusty jobs open - hope that's zero once all open reviews are in. | 21:10 |
| * AJaeger calls it a day and waves good-night | 21:10 | |
| pleia2 | night AJaeger | 21:10 |
| openstackgerrit | James E. Blair proposed openstack/gertty: Add config option for git clone URL https://review.openstack.org/169469 | 21:10 |
| *** _nadya_ has quit IRC | 21:11 | |
| fungi | thanks AJaeger!!! | 21:12 |
| pabelanger | indeed thanks AJaeger | 21:13 |
| *** sridhar_ram1 has quit IRC | 21:13 | |
| openstackgerrit | Merged openstack-infra/project-config: hacking: Use ubuntu-trusty https://review.openstack.org/290783 | 21:13 |
| *** nwkarsten has quit IRC | 21:13 | |
| openstackgerrit | Merged openstack-infra/project-config: gate-bashate-devstack: Use ubuntu-trusty https://review.openstack.org/290796 | 21:13 |
| openstackgerrit | Mark Vanderwiel proposed openstack-infra/project-config: job gate-heat-templates-dsvm is broken https://review.openstack.org/290860 | 21:14 |
| *** nwkarsten has joined #openstack-infra | 21:14 | |
| *** cloudtrainme has quit IRC | 21:14 | |
| *** sridhar_ram has joined #openstack-infra | 21:15 | |
| *** _nadya_ has joined #openstack-infra | 21:15 | |
| bswartz | guys I can't find the gerrit acls for openstack/manila-image-elements anywhere -- is it possible that gerrit is inheriting the acls from some other project? | 21:15 |
| openstackgerrit | Brant Knudson proposed openstack-infra/release-tools: Add update_reviews tool https://review.openstack.org/290853 | 21:15 |
| clarkb | bswartz: most (all maybe) projects do inherit from a single root project if they don't otherwise have rules | 21:15 |
| *** aeng_afk is now known as aeng | 21:15 | |
| *** _nadya_ has quit IRC | 21:15 | |
| clarkb | bswartz: that project is called All-Projects and should be viewable via gerrit webui | 21:15 |
| openstackgerrit | Armando Migliaccio proposed openstack-infra/elastic-recheck: Add query for bug 1531862 https://review.openstack.org/290861 | 21:16 |
| openstack | bug 1531862 in neutron "ServerPersonalityTestJSON:test_rebuild_server_with_personality fails intermittent" [Critical,Confirmed] https://launchpad.net/bugs/1531862 | 21:16 |
| armax | mriedem: ^ this seems to be getting annoying | 21:16 |
| bswartz | how is it possible that the manila core team can +2 stuff though? that wouldn't be part of the default acls would it? | 21:16 |
| *** ldnunes has quit IRC | 21:16 | |
| clarkb | bswartz: that wouldn't be | 21:17 |
| clarkb | bswartz: https://review.openstack.org/#/admin/projects/openstack/manila-image-elements,access is what is in gerrit | 21:17 |
| mriedem | armax: so that's a pretty generic failure, is there something in the logs that would be closer to the failure? | 21:17 |
| armax | mriedem: I’ll have to drill down and take a closer look, but who’s got the time? :) | 21:18 |
| armax | mriedem: at least not today | 21:18 |
| mriedem | now that i've context switched i'll look | 21:18 |
| bswartz | is it getting the same acls as openstack/manila because openstack/manila is a substring of openstack/manila-image-elements? | 21:18 |
| armax | mriedem: I can have a closer look, or dispatch one of my minions | 21:18 |
| clarkb | bswartz: no, we don't substring match, but you might get the same rules if you explicit told it to use the manila.conf in projects.yaml | 21:19 |
| mriedem | armax: easy http://logs.openstack.org/39/285339/3/gate/gate-tempest-dsvm-neutron-linuxbridge/85afef0/logs/screen-n-cpu.txt.gz?level=TRACE#_2016-03-09_19_59_25_762 | 21:19 |
| bswartz | let me check that | 21:20 |
| armax | that’s just as broad :) | 21:20 |
| *** markvoelker has quit IRC | 21:20 | |
| bswartz | clarkb: you got it | 21:20 |
| armax | I think this has to do with the port wiring | 21:20 |
| bswartz | I will fix this | 21:20 |
| armax | mriedem: http://logs.openstack.org/39/285339/3/gate/gate-tempest-dsvm-neutron-linuxbridge/85afef0/logs/screen-n-cpu.txt.gz?level=TRACE#_2016-03-09_19_59_25_759 | 21:20 |
| mriedem | oo | 21:21 |
| mriedem | http://logstash.openstack.org/#dashboard/file/logstash.json?query=message%3A%5C%22poweroff%5C%22%20AND%20message%3A%5C%22libvirtError%3A%20Domain%20not%20found%3A%20no%20domain%20with%20matching%20uuid%5C%22%20AND%20tags%3A%5C%22screen-n-cpu.txt%5C%22&from=yd | 21:22 |
| mriedem | oops | 21:22 |
| *** tonytan4ever has quit IRC | 21:22 | |
| mriedem | http://logstash.openstack.org/#dashboard/file/logstash.json?query=message%3A%5C%22poweroff%5C%22%20AND%20message%3A%5C%22libvirtError%3A%20Domain%20not%20found%3A%20no%20domain%20with%20matching%20uuid%5C%22%20AND%20tags%3A%5C%22screen-n-cpu.txt%5C%22&from=7d | 21:22 |
| anteaya | paste it again | 21:22 |
| *** tonytan4ever has joined #openstack-infra | 21:22 | |
| *** xarses_ is now known as xarses | 21:22 | |
| openstackgerrit | Merged openstack-infra/project-config: bifrost: Use ubuntu-trusty https://review.openstack.org/290798 | 21:23 |
| openstackgerrit | Merged openstack-infra/project-config: Change two tox jobs to ubuntu-trusty https://review.openstack.org/290807 | 21:23 |
| mriedem | armax: use this message:"Timeout waiting for vif plugging callback for instance" AND tags:"screen-n-cpu.txt" AND build_name:"gate-tempest-dsvm-neutron-linuxbridge" | 21:23 |
| openstackgerrit | Ricardo Carrillo Cruz proposed openstack-infra/shade: Follow name_or_id pattern on domain operations https://review.openstack.org/288715 | 21:23 |
| armax | mriedem, mtreinish ^ | 21:24 |
| *** sdague_ has joined #openstack-infra | 21:24 | |
| armax | mriedem: let me see what comes up | 21:24 |
| armax | mriedem: I didn’t want to restrict to linuxbridge only though, as this might surface with ovs too, is that ok? | 21:24 |
| clarkb | pabelanger: any idea if these job updates are large enough to require babysitting jjb? | 21:25 |
| *** cloudtrainme has joined #openstack-infra | 21:25 | |
| *** doug-fish has joined #openstack-infra | 21:25 | |
| pabelanger | clarkb: I think most are pretty small | 21:26 |
| openstackgerrit | Merged openstack-infra/project-config: gate-storyboard-js-integration: Use ubuntu-trusty https://review.openstack.org/290791 | 21:26 |
| pabelanger | there was one, let check if that was merged | 21:26 |
| clarkb | pabelanger: ya appear to be, probably don't need to watch jjb | 21:26 |
| mriedem | armax: it shows up in another job but it's a non-voting job | 21:26 |
| mriedem | armax: so i'd filter on the lb job | 21:26 |
| armax | mriedem: ok | 21:26 |
| clarkb | pabelanger: I think I have approved all of them except the one WIP one | 21:27 |
| armax | mriedem: I guess that would be good enough | 21:27 |
| openstackgerrit | Armando Migliaccio proposed openstack-infra/elastic-recheck: Add query for bug 1531862 https://review.openstack.org/290861 | 21:27 |
| openstack | bug 1531862 in neutron "ServerPersonalityTestJSON:test_rebuild_server_with_personality fails intermittent" [Critical,Confirmed] https://launchpad.net/bugs/1531862 | 21:27 |
| anteaya | so german to english translation of flex time is "gliding time hours", which I like very much | 21:27 |
| openstackgerrit | Ben Swartzlander proposed openstack-infra/project-config: Give manila-image-elements its own acls https://review.openstack.org/290865 | 21:28 |
| pabelanger | clarkb: Ya, I was only really concerned with 289848 but that merged already | 21:28 |
| openstackgerrit | David Moreau Simard proposed openstack-infra/devstack-gate: Use dd to create swapfile, ensure swap amount == 8GB https://review.openstack.org/290776 | 21:29 |
| pabelanger | clarkb: wfm | 21:29 |
| openstackgerrit | David Moreau Simard proposed openstack-infra/devstack-gate: Use dd to create swapfile, ensure swap amount == 8GB https://review.openstack.org/290776 | 21:29 |
| *** derekh_afk is now known as derekh | 21:29 | |
| *** thorst__ is now known as thorst_ | 21:30 | |
| openstackgerrit | Merged openstack-infra/project-config: dib-buildimage-debian-ironic: Use ubuntu-trusty https://review.openstack.org/290786 | 21:30 |
| openstackgerrit | David Moreau Simard proposed openstack-infra/devstack-gate: Use dd to create swapfile, ensure swap amount == 8GB https://review.openstack.org/290776 | 21:31 |
| openstackgerrit | Merged openstack-infra/project-config: Change heat-templates-buildimages to use ubuntu-trusty https://review.openstack.org/290784 | 21:31 |
| openstackgerrit | Armando Migliaccio proposed openstack-infra/elastic-recheck: Add query for bug 1531862 https://review.openstack.org/290861 | 21:31 |
| openstack | bug 1531862 in neutron "ServerPersonalityTestJSON:test_rebuild_server_with_personality fails intermittent" [Critical,Confirmed] https://launchpad.net/bugs/1531862 | 21:31 |
| *** keedya has quit IRC | 21:32 | |
| dmsimard | Hm, the server fails a personality test ? Is it a bad and mean server ? /me looks at what that test does | 21:33 |
| openstackgerrit | Merged openstack-infra/project-config: Convert gerrit jobs to ubuntu-trusty https://review.openstack.org/290779 | 21:34 |
| clarkb | dmsimard: have a link? | 21:34 |
| dmsimard | clarkb: was just linked from a review ^ https://launchpad.net/bugs/1531862 | 21:34 |
| openstack | Launchpad bug 1531862 in neutron "ServerPersonalityTestJSON:test_rebuild_server_with_personality fails intermittent" [Critical,Confirmed] | 21:34 |
| clarkb | dmsimard: oh nova personality things | 21:34 |
| dmsimard | yeah never seen that before, just curious what it is | 21:34 |
| dmsimard | "personality" sounds like an odd description for a feature/thing | 21:35 |
| clarkb | it is | 21:35 |
| clarkb | and iirc it isn't a good descriptor | 21:35 |
| clarkb | dmsimard: http://docs.openstack.org/developer/nova/v2/2.0_server_concepts.html#server-personality | 21:35 |
| fungi | it's basically a hash of some cpu options | 21:36 |
| anteaya | great now we need server psychoanalists | 21:36 |
| fungi | used to make sure, for example, that you don't try to live-migrate an instance onto processors which are incapable of making the calls in flight | 21:36 |
| dmsimard | "personalization" yikes, sounds like a weird translation for what was probably meant to be "customization" | 21:36 |
| fungi | it's not really customization | 21:37 |
| dmsimard | customization in french would be something like "personnalisation" | 21:37 |
| *** baoli has joined #openstack-infra | 21:37 | |
| fungi | a particular personality is like a collection of traits the system has which can be used to identify like-minded hosts | 21:37 |
| dmsimard | oh, in that perspective it makes sense | 21:37 |
| *** dims has joined #openstack-infra | 21:37 | |
| dmsimard | TIL | 21:38 |
| fungi | it's not uncommon to basically "hide" some processor traits to make your lowest-common-denominator the consistent personality you present to virtual machine instances | 21:39 |
| anteaya | eharmony for clouds | 21:39 |
| fungi | as a means of making a somewhat heterogenous set of hosts look more homogenous to the hypervisor | 21:40 |
| openstackgerrit | Merged openstack-infra/project-config: gate-anvil-venv-{node}: Use ubuntu-trusty https://review.openstack.org/290831 | 21:40 |
| *** _ari_ has quit IRC | 21:40 | |
| craige | Are any infra roots able to take a quick squiz at the jenkins error for 289648? It looks like it's failing repeatedly due to a persistent puppet problem unrelated to my change (although I could well be wrong) | 21:41 |
| fungi | craige: pabelanger had a fix proposed, if it's the locale issue we were running into | 21:41 |
| openstackgerrit | Merged openstack-infra/elastic-recheck: Add query for bug 1531862 https://review.openstack.org/290861 | 21:42 |
| openstack | bug 1531862 in neutron "ServerPersonalityTestJSON:test_rebuild_server_with_personality fails intermittent" [Critical,Confirmed] https://launchpad.net/bugs/1531862 | 21:42 |
| fungi | or at least a workaround | 21:42 |
| craige | Thanks fungi but I was wrong. | 21:42 |
| craige | Just after I posted that I discovered it is *is* my problem :-D | 21:42 |
| fungi | hah | 21:42 |
| fungi | happens to me *all* the time | 21:42 |
| clarkb | fungi: pabelanger http://logs.openstack.org/38/290838/1/gate/gate-bindep-fallback-fedora-23/90c7d9c/console.html | 21:43 |
| *** sarob has joined #openstack-infra | 21:43 | |
| *** sdake has quit IRC | 21:44 | |
| clarkb | looks like rax-ord fedora-23 doesn't have bindep? | 21:44 |
| fungi | clarkb: probably very old image? we should delete there if so | 21:44 |
| fungi | looking | 21:44 |
| fungi | clarkb: yep, newest there is a week old | 21:46 |
| fungi | deleting the fedora-23 images from rax-ord for now. other rax regions have ready images less than a day old | 21:46 |
| *** |-paul-| has quit IRC | 21:47 | |
| clarkb | kk | 21:47 |
| openstackgerrit | Ricardo Carrillo Cruz proposed openstack-infra/shade: Follow name_or_id pattern on domain operations https://review.openstack.org/288715 | 21:47 |
| clarkb | I will recheck that change | 21:47 |
| jhesketh | Morning | 21:47 |
| fungi | luckily rax-ord has a low quota, so hopefully minimal damage done | 21:47 |
| fungi | since fedora-23 doesn't get used much | 21:47 |
| clarkb | ya | 21:47 |
| *** yamahata has joined #openstack-infra | 21:47 | |
| *** dtardivel has quit IRC | 21:48 | |
| *** arxcruz has joined #openstack-infra | 21:50 | |
| *** gyee has joined #openstack-infra | 21:51 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/puppet-log_processor: Decouple log processing from logstash https://review.openstack.org/247857 | 21:52 |
| openstackgerrit | Craige McWhirter proposed openstack-infra/system-config: Initial commit of the Phabricator puppetry. https://review.openstack.org/289648 | 21:53 |
| clarkb | I am going to try getting ^ and friends deployed this week, likely tomorrow. There has been a lack of reviews but logstash 2.0 without the separate ES daemon is much more reliable so I will probably just go ahead and push taht through | 21:53 |
| dmsimard | phabricator ? Are you looking to move away from gitweb/github ? | 21:54 |
| pabelanger | Ya, old images. Seen that on ovh too | 21:54 |
| pabelanger | but think we fix it | 21:54 |
| *** ashleigh_ has quit IRC | 21:54 | |
| clarkb | dmsimard: no, it would purely be for maniphest | 21:54 |
| *** camunoz_ has joined #openstack-infra | 21:55 | |
| dmsimard | okay :) | 21:55 |
| *** infra-red has quit IRC | 21:55 | |
| *** camunoz has quit IRC | 21:55 | |
| fungi | dmsimard: or phrased differently, we're looking to move away from launchpad | 21:56 |
| *** dims has quit IRC | 21:56 | |
| dmsimard | storyboard is not going to make the cut, then ? | 21:56 |
| dmsimard | or just exploring options ? | 21:56 |
| *** _sarob has joined #openstack-infra | 21:56 | |
| fungi | dmsimard: storyboard and maniphest are the current possibilities we've seen | 21:56 |
| * craige wonders if gitlab had been considered. | 21:57 | |
| *** ashleighfarnham has joined #openstack-infra | 21:57 | |
| openstackgerrit | Ricardo Carrillo Cruz proposed openstack-infra/shade: Follow name_or_id pattern on domain operations https://review.openstack.org/288715 | 21:57 |
| clarkb | I think gitlab was rejected for many of the same reasons github is rejected | 21:57 |
| *** _sarob has quit IRC | 21:57 | |
| fungi | did gitlab grow a task/defect tracker? | 21:57 |
| *** cloudtrainme has quit IRC | 21:57 | |
| clarkb | it doesn't actually do the thing we need well | 21:57 |
| * craige nods | 21:57 | |
| *** _sarob has joined #openstack-infra | 21:57 | |
| *** kgiusti has left #openstack-infra | 21:57 | |
| fungi | well, you _can_ run your own gitlab (ce, it's "open-core" unfortunately) | 21:58 |
| clarkb | fungi: I think it has the rudimentary bug tracker stuff from github of couple years ago | 21:58 |
| fungi | eep | 21:58 |
| fungi | no thank you | 21:58 |
| * craige runs gitlab but hasn't run it against the infra- reqs | 21:58 | |
| *** dims has joined #openstack-infra | 21:58 | |
| craige | and doersn't do bug tracking | 21:58 |
| dmsimard | gitlab issues is no better than github issues last I know | 21:59 |
| *** cloudtrainme has joined #openstack-infra | 21:59 | |
| *** Sukhdev has joined #openstack-infra | 21:59 | |
| fungi | the big issue we have is our need to track overarching work across tasks in multiple different projects | 22:00 |
| pleia2 | our tracker need are... complicated | 22:00 |
| craige | :-) | 22:00 |
| pleia2 | yeah, that's the one thing that launchpad does really well that's lacking in most others | 22:00 |
| fungi | and across multiple branches of the same projects | 22:00 |
| pleia2 | well, "really well" until you add too many projects and the server times out :) | 22:00 |
| pleia2 | but the idea was good | 22:00 |
| *** sarob has quit IRC | 22:00 | |
| pleia2 | and works for most people | 22:00 |
| fungi | their model for it was not terrible | 22:01 |
| fungi | s/was/is/ | 22:01 |
| *** flepied has quit IRC | 22:01 | |
| *** sridhar_ram1 has joined #openstack-infra | 22:02 | |
| *** thorst_ has quit IRC | 22:02 | |
| openstackgerrit | Matt Riedemann proposed openstack/requirements: Tolerate both new and old setuptools https://review.openstack.org/290877 | 22:03 |
| *** eharney has quit IRC | 22:04 | |
| *** abregman has quit IRC | 22:04 | |
| openstackgerrit | Matt Riedemann proposed openstack/requirements: Updated from global requirements https://review.openstack.org/246114 | 22:04 |
| *** sridhar_ram has quit IRC | 22:04 | |
| *** flepied has joined #openstack-infra | 22:04 | |
| *** EricGonczer_ has quit IRC | 22:05 | |
| *** thorst_ has joined #openstack-infra | 22:05 | |
| *** EricGonczer_ has joined #openstack-infra | 22:05 | |
| anteaya | clarkb: yay logstash 2.0 | 22:06 |
| openstackgerrit | Merged openstack-infra/project-config: beaker-jobs: Convert to ubuntu-trusty https://review.openstack.org/290838 | 22:07 |
| *** dimtruck is now known as zz_dimtruck | 22:07 | |
| *** thorst_ has quit IRC | 22:09 | |
| openstackgerrit | Michael Johnson proposed openstack-infra/project-config: Setup neutron-lbaas-dashboards for release https://review.openstack.org/290878 | 22:09 |
| openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci: Reuse the source-repositories cache during the image build https://review.openstack.org/290879 | 22:11 |
| *** eharney has joined #openstack-infra | 22:11 | |
| *** Sukhdev has quit IRC | 22:14 | |
| craige | I'm having a MySQL puppet password configuration issue and wondered if anyone could point me at the correct doco? i'm clearly managing it wrong :-) | 22:14 |
| mordred | craige: btw- looked at the SQL | 22:15 |
| mordred | the weird IDs in the task table | 22:15 |
| craige | Yes. | 22:15 |
| craige | Very weird. Any thoughts? | 22:16 |
| *** ddieterly has joined #openstack-infra | 22:16 | |
| mordred | are the result of code ... hrm | 22:16 |
| *** IlyaG has quit IRC | 22:16 | |
| craige | I've tried looking at the Storyboard code to see how they handle it there. | 22:16 |
| mordred | do you have a copy of the sql migration in a repo anywhere? I was going to point you at something | 22:16 |
| craige | No love, yet. | 22:16 |
| mordred | craige: it's the result of a data tranformation we do in the migration | 22:16 |
| craige | Yes, I do. | 22:16 |
| mordred | cool | 22:16 |
| *** gordc has quit IRC | 22:16 | |
| * craige link gets | 22:17 | |
| *** sdague_ has quit IRC | 22:17 | |
| *** sdague has quit IRC | 22:17 | |
| craige | The current version of the migration SLQ is in #254066 mordred | 22:18 |
| craige | SQL, too | 22:18 |
| *** burgerk_ has joined #openstack-infra | 22:18 | |
| craige | oh, so there ID issue is one the migration creates? | 22:18 |
| * craige kicks himself for not looking at the fresh import of storyboard DB. | 22:19 | |
| *** derekh has quit IRC | 22:19 | |
| *** david-lyle has quit IRC | 22:19 | |
| *** david-lyle has joined #openstack-infra | 22:20 | |
| *** burgerk has quit IRC | 22:21 | |
| ianw | jeblair / fungi : when you have time -> https://review.openstack.org/#/c/290214/ afs rpm build. i think that's ready to go (and I'm ready to debug it :) | 22:22 |
| mordred | craige: http://git.openstack.org/cgit/openstack-infra/system-config/tree/tools/phabricator/migrate-to-phab.sql#n127 | 22:22 |
| * craige looks | 22:22 | |
| *** krtaylor has quit IRC | 22:23 | |
| fungi | ianw: popping that onto the stack, though i'm about to disappear and go out to eat something | 22:23 |
| jeblair | ianw: instead of using a jenkins script, maybe we should just just inline it into the job? | 22:23 |
| mordred | craige: I think 137 is the bug | 22:24 |
| jeblair | ianw: it's only used in the one job, and that way we don't have to wait for image builds if we want to change it. | 22:24 |
| mordred | craige: that should be >= not < | 22:24 |
| *** thorst_ has joined #openstack-infra | 22:24 | |
| ianw | jeblair: not totally opposed, it's just easier to edit than bash-in-yaml | 22:24 |
| anteaya | cat was walking across keyboard, fortunately she stepped around the enter key | 22:24 |
| *** amrith is now known as _amrith_ | 22:24 | |
| anteaya | fungi: enjoy food | 22:25 |
| jeblair | ianw: i hear that. hopefully we won't really edit it though after this, and inline, we get to try it out before next week :) | 22:25 |
| ianw | jeblair: does jjb have a "include from this file" option? haven't looked for that... | 22:25 |
| craige | ah, OK. I'll make that change and see how it flies. Thanks for taking a look mordred. I would ont have picked that up. | 22:25 |
| *** IlyaG has joined #openstack-infra | 22:25 | |
| mordred | craige: well - this is what happens when I get clever and write the data migration in pure SQL | 22:25 |
| jeblair | ianw: i believe it does. | 22:25 |
| jeblair | ianw: (i think it's a standard-ish yaml include?) | 22:26 |
| ianw | maybe even the yaml parser does ... yaml is turning complete, yes? :) | 22:26 |
| *** amitgandhinz has quit IRC | 22:26 | |
| *** hashar has quit IRC | 22:26 | |
| craige | heh | 22:26 |
| craige | I'll see if I can get this running before I board mordred | 22:26 |
| ianw | Turing, even | 22:26 |
| mordred | craige: woot! | 22:26 |
| craige | ah no, just got called, damn it. | 22:26 |
| mordred | craige: it'll be still be there when you land | 22:27 |
| craige | :-) | 22:27 |
| openstackgerrit | Max V.K. proposed openstack-infra/jenkins-job-builder: upd google-cloud-storage plugin support https://review.openstack.org/287497 | 22:27 |
| *** angdraug has joined #openstack-infra | 22:28 | |
| *** jcoufal has quit IRC | 22:28 | |
| *** automagically_ has joined #openstack-infra | 22:28 | |
| *** dims has quit IRC | 22:29 | |
| *** burgerk_ has quit IRC | 22:29 | |
| openstackgerrit | Ricardo Carrillo Cruz proposed openstack-infra/shade: Follow name_or_id pattern on domain operations https://review.openstack.org/288715 | 22:30 |
| *** [1]Thelo has joined #openstack-infra | 22:30 | |
| *** mriedem has quit IRC | 22:31 | |
| fungi | jeblair: ianw: i'm not finding a file inclusion spec in the yaml standard | 22:32 |
| *** kencjohnston has quit IRC | 22:32 | |
| ianw | fungi: yeah ... i have strong deja-vu about pabelanger implementing something like this for nodepool configuration | 22:32 |
| jeblair | ianw: http://docs.openstack.org/infra/jenkins-job-builder/definition.html#module-jenkins_jobs.local_yaml | 22:32 |
| jeblair | so yeah, not standard, but supported | 22:33 |
| *** Thelo has quit IRC | 22:33 | |
| *** [1]Thelo is now known as Thelo | 22:33 | |
| fungi | jjbism | 22:33 |
| *** roxanagh_ has quit IRC | 22:33 | |
| fungi | cool enough | 22:33 |
| fungi | at least until we need ansible to also support it i guess | 22:33 |
| ianw | jeblair: it seems this would be the first use in project-config? i'm not opposed to changing it, if that's something we want to open the doors to | 22:34 |
| *** asettle has joined #openstack-infra | 22:34 | |
| jeblair | ianw: i'm only suggesting that we avoid a jenkins script. i don't have an opinion on whether we should use the include. | 22:34 |
| *** EricGonczer_ has quit IRC | 22:34 | |
| openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: Kill CI job if it doesn't get a testenv quickly https://review.openstack.org/290731 | 22:35 |
| fungi | yeah, we've embedded plenty of lengthy shell scripts in job definitions in the past | 22:35 |
| *** jpr has quit IRC | 22:35 | |
| *** yamahata has quit IRC | 22:35 | |
| pabelanger | ianw: Ya, I did something like that, but was rejected | 22:35 |
| fungi | often later moving them into standalone "slave scripts" | 22:35 |
| *** krtaylor has joined #openstack-infra | 22:36 | |
| fungi | the install-distro-packages macro we're using for bindep execution started out that way for example | 22:36 |
| ianw | jeblair: if I were to use !include ... would you +2 it? :) | 22:36 |
| pabelanger | however, we could do something like: https://review.openstack.org/#/c/152290/ | 22:36 |
| anteaya | pabelanger: what is the status of the spam on the wiki? | 22:36 |
| *** piet has quit IRC | 22:36 | |
| fungi | i'm somewhere in the -0.5 range on adding things in our jjb configus which will be complex to support in zuul v3 | 22:37 |
| anteaya | pabelanger: are there pages that still need to be deleted? | 22:37 |
| *** tpsilva has quit IRC | 22:37 | |
| pabelanger | anteaya: for the most part undercontrol | 22:37 |
| *** piet has joined #openstack-infra | 22:37 | |
| pabelanger | I see a bot every few days doing something and delete it | 22:37 |
| anteaya | so the spam has been deleted? | 22:37 |
| pabelanger | yes, manually. | 22:37 |
| anteaya | okay great, thank you | 22:37 |
| fungi | pabelanger: was there a plan for what we should do next before we can reenable account creation via openid? | 22:38 |
| anteaya | what is our status yeah what fungi said | 22:38 |
| pabelanger | I think 287232 will help automate it | 22:38 |
| pabelanger | fungi: see ^ | 22:38 |
| anteaya | just had a question in -dev about wiki accounts | 22:38 |
| pabelanger | I think we can land that, and have admins be able to use it | 22:38 |
| *** zz_dimtruck is now known as dimtruck | 22:38 | |
| pabelanger | which should nuke all new spam coming | 22:38 |
| fungi | pabelanger: awesome. will review. thanks! | 22:38 |
| pabelanger | I we can try and land 288785 too, manually if needed to test openid account creation | 22:39 |
| *** asettle has quit IRC | 22:39 | |
| fungi | will have a peek at that one as well | 22:39 |
| *** jtomasek has quit IRC | 22:39 | |
| fungi | but yeah, we've had a few people wander in wondering why they can't create an account to edit the wiki, so we should get this buttoned up and be able to move on or at least see if there's more still needed | 22:40 |
| pabelanger | anteaya: fungi: ultimately we should see how to migrate to openstackid.org since it should have less spam bots | 22:40 |
| *** ybathia has joined #openstack-infra | 22:41 | |
| anteaya | yes, but I think that has its own difficulties | 22:41 |
| anteaya | but I agree launchpad open id isn't filtering well | 22:41 |
| anteaya | pabelanger: on 288785 the commit message says The goal here is to allow mediawiki to create an openid user while leaving the createaccount permission false. | 22:41 |
| anteaya | pabelanger: why is doing that useful? | 22:42 |
| pabelanger | anteaya: that way mobile users cannot create accounts and we force people through openid | 22:42 |
| anteaya | ah | 22:42 |
| anteaya | thanks | 22:42 |
| pabelanger | that was an attack vector for spammers | 22:42 |
| *** ybathia has quit IRC | 22:42 | |
| anteaya | pabelanger: would you mind adding that bit to the commit message? | 22:42 |
| fungi | pabelanger: yep, mrmartin was also pondering the migration process, i agree getting that nailed down soon would be good too | 22:43 |
| *** _sarob has quit IRC | 22:43 | |
| *** regXboi has quit IRC | 22:43 | |
| jeblair | expect spam openstackid.org accounts. | 22:43 |
| openstackgerrit | Paul Belanger proposed openstack-infra/puppet-mediawiki: Set wgOpenIDUseEmailAsNickname True by default https://review.openstack.org/288785 | 22:44 |
| *** Sukhdev has joined #openstack-infra | 22:44 | |
| *** rguillebert has joined #openstack-infra | 22:44 | |
| *** dims has joined #openstack-infra | 22:44 | |
| pabelanger | yup | 22:45 |
| pabelanger | upgrading to trusty should be done too | 22:45 |
| pabelanger | I haven't tested puppet-mediawiki on trusty yet | 22:45 |
| *** Sukhdev has quit IRC | 22:46 | |
| anteaya | pabelanger: thanks | 22:47 |
| anteaya | it was the mobile vector bit I was missing, so I added it in a comment on the patch with my review. | 22:47 |
| fungi | oh yes, i do expect we'll attract spammers signing up for openstackid.org once we do that | 22:47 |
| openstackgerrit | Matthew Thode proposed openstack/diskimage-builder: Add testing for the Gentoo element https://review.openstack.org/290894 | 22:48 |
| fungi | anyway, time to go find some grub. back later | 22:48 |
| *** abregman has joined #openstack-infra | 22:48 | |
| *** abregman has quit IRC | 22:48 | |
| anteaya | enjoy | 22:50 |
| *** thorst_ has quit IRC | 22:51 | |
| *** thorst_ has joined #openstack-infra | 22:52 | |
| clarkb | the dd for swapfile takes ~1 minute on bluebox | 22:53 |
| SamYaple | clarkb: the other day you were tlaking about dib and you mentioned you were building ~6GB images (with all the git cache stuff). Is that something I can test locally to see the full effect of this fstrim patch? | 22:53 |
| clarkb | SamYaple: yup, though beware it does a ton of IO | 22:53 |
| SamYaple | ive got plenty | 22:53 |
| SamYaple | ill just be doing it all in ram anyway | 22:54 |
| clarkb | you have 17GB of ram? | 22:54 |
| SamYaple | i have 128GB | 22:54 |
| SamYaple | on this machine | 22:54 |
| clarkb | SamYaple: https://git.openstack.org/cgit/openstack-infra/project-config/tree/tools/build-image.sh#n26 | 22:54 |
| clarkb | SamYaple: use the ubuntu-minimal element instead of $DISTRO | 22:54 |
| *** tonytan4ever has quit IRC | 22:55 | |
| clarkb | SamYaple: and that should give you a rough idea of size, add simple-init if yo uwant to make it bootable in a cloud | 22:55 |
| SamYaple | okiedokie. | 22:55 |
| *** Sukhdev has joined #openstack-infra | 22:55 | |
| SamYaple | didnt get to the fstrim patch yesterday. was sick | 22:55 |
| anteaya | clarkb: that seems like quite a while for swapfile | 22:57 |
| clarkb | anteaya: it is writing 8 gigabytes of zeros | 22:57 |
| *** baoli has quit IRC | 22:57 | |
| *** sridhar_ram1 has quit IRC | 22:57 | |
| clarkb | SamYaple: raw should be roughly 17GB, if fstrim works it should be just under 6GB when qcow2 compressed | 22:57 |
| *** aeng has quit IRC | 22:58 | |
| *** bpokorny_ has joined #openstack-infra | 22:58 | |
| anteaya | clarkb: that is a lot of zeros | 23:01 |
| *** Sukhdev has quit IRC | 23:01 | |
| SamYaple | ERROR: Element 'openstack-repos' not found in 'diskimage_builder/../bin/../elements' | 23:01 |
| *** rbrndt__ has joined #openstack-infra | 23:01 | |
| *** aeng has joined #openstack-infra | 23:01 | |
| SamYaple | mind you i know little of dib, but my repo is up-to-date | 23:01 |
| *** zaro has quit IRC | 23:01 | |
| *** zaro has joined #openstack-infra | 23:01 | |
| *** rbrndt_ has quit IRC | 23:01 | |
| *** baoli has joined #openstack-infra | 23:01 | |
| clarkb | SamYaple: you need the ELEMENTS_PATH from that script | 23:01 |
| *** gildub has quit IRC | 23:01 | |
| clarkb | SamYaple: if you just cp that script and edit it to s/$DISTRO/ubuntu-minimal/ you are good | 23:01 |
| *** pahuang has quit IRC | 23:01 | |
| *** f1ller has quit IRC | 23:01 | |
| *** thorst_ has quit IRC | 23:01 | |
| SamYaple | yes it is exported | 23:01 |
| *** cschwede has quit IRC | 23:01 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/project-config: Build AFS RPMs for Centos7 periodically https://review.openstack.org/290214 | 23:01 |
| openstackgerrit | Ian Wienand proposed openstack-infra/project-config: Add Centos7 wheel cache jobs https://review.openstack.org/290272 | 23:01 |
| *** gildub has joined #openstack-infra | 23:01 | |
| SamYaple | nodepool/elements is from where? | 23:01 |
| *** bpokorny has quit IRC | 23:01 | |
| *** pvaneck has quit IRC | 23:01 | |
| *** pahuang has joined #openstack-infra | 23:01 | |
| clarkb | SamYaple: that same repo up a dir | 23:01 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!